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ABSTRACT 


The  FY  2003  Federal  Budget  contains  provisions  for  over  $52  billion  in  IT 
investments.  The  Navy  portion  of  those  funds  is  over  $5  billion.  Rapid  change  and 
increasing  uncertainty  in  the  technology  field  has  resulted  in  a  high  degree  of  financial 
risk  associated  with  IT  capital  investment  decisions.  The  Federal  Chief  Information 
Officer  (CIO)  Council  has  endorsed  IT  Portfolio  Management  (ITPM)  as  an  approach  for 
making  IT  investment  decisions.  This  research  draws  upon  ITPM  implementation 
strategies  currently  employed  by  the  DON  and  provides  recommendations  for  managing 
the  inherent  risk  in  IT  investments,  specifically  the  application  of  the  Real  Options 
Method  (ROM).  ITPM  provides  a  thoughtful  framework  for  managing  the  capital 
investment  process  but  still  depends  primarily  on  traditional  methods  such  as  EVA,  IRR 
and  NPV  for  evaluating  IT  investment  alternatives.  This  study  uses  the  Naval  Supply 
Systems  Command  (NAVSUP)  Automatic  Identification  Technology  (AIT)  program  to 
illustrate  how  ROM  can  be  utilized  to  supplement  these  traditional  valuation  methods  and 
aid  in  managing  investment  risks.  IT  capital  investments  are  inherently  linked  to 
organization  strategy  and  the  uncertainties  that  define  the  future.  This  study 
demonstrates  how  ROM  can  allow  managers  to  capitalize  on  the  uncertainties  of  IT 
investment  decisions  to  implement  organization  strategy. 
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I.  INTRODUCTION 


A.  BACKGROUND 

The  FY  2003  Federal  Budget  contains  provisions  for  over  $52  billion  in  IT 
investments  (Federal  CIO  Council  2002).  The  Navy  portion  of  those  funds  is  over  $5 
billion.  One  of  the  most  difficult  issues  facing  the  DON  is  determining  how  these  funds 
should  be  used  and  evaluating  the  validity  of  current  IT  investments.  Rapid  change  and 
increasing  uncertainty  in  the  technology  field  have  resulted  in  a  high  degree  of  financial 
risk  associated  with  IT  capital  investment.  This  incredibly  rapid  pace  of  change  in  the 
world  of  IT  creates  a  major  dilemma  for  those  charged  with  determining  how  these  funds 
are  invested.  It  is  particularly  difficult  to  determine  what  to  invest  in,  how  much  to 
invest,  and  how  to  evaluate  investments  while  attempting  to  manage  associated  financial 
risks.  Answering  these  questions  become  more  important  as  the  cost  of  IT  investment 
continues  to  rise  and  financial  resources  become  more  constrained. 

Congress  has  addressed  this  challenge  through  the  passage  of  the  Clinger-Cohen 
Act  of  1996,  which  provides  a  framework  for  government  IT  acquisition.  Likewise,  the 
Department  of  Defense  (DOD)  acquisition  reform  efforts  have  addressed  the  unique 
challenges  involving  the  selection  and  fielding  of  major  IT  system  acquisitions.  The 
Federal  Chief  Information  Officer  (CIO)  Council  has  endorsed  IT  Portfolio  Management 
(ITPM)  as  the  approach  for  making  IT  investment  decisions.  ITPM  is  a  system  for 
evaluating,  selecting,  prioritizing,  budgeting  and  planning  for  investments  to  maximize 
the  benefits  to  an  organization  (Federal  CIO  Council  2002).  The  DOD  and  DON 
Information  Technology/Information  Management  (IT/IM)  leadership  have  established 
that  ITPM  principles  will  guide  IT  investment  decisions.  In  turn,  organizations,  such  as 
the  Naval  Supply  Systems  Command  (NAVSUP),  have  implemented  an  ITPM  approach 
to  its  budgeting  and  resource  allocation  processes  for  IT. 

Many  DON  organizations  are  now  actively  employing  ITPM  for  IT  investment 
decisions.  Still,  these  organizations  must  address  the  issue  of  managing  the  financial 
risks  inherent  to  IT  investment  that  may  not  be  adequately  addressed  through  commonly 
used  tools  like  discounted  cash  flow  analysis  (DCF),  decision  tree  analysis  and  net 
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present  value  (NPV).  The  Real  Optbns  Method  (ROM)  is  a  tool  historically  used  in 
financial  markets  for  managing  risk.  In  recent  years,  it  has  gained  prominence  as  a 
method  of  managing  capital  investment  risk  in  areas  such  as  pharmaceutical  R&D, 
petroleum  exploration  and  energy  trading  (Boer  2002).  Since  ITPM  is  based  on  Modern 
Portfolio  Theory  derived  from  the  capital  markets,  ROM  may  have  a  role  in  managing  IT 
investment  risk.  Analysis  of  the  benefits  and  limitations  of  utilizing  ROM  with  ITPM  is 
an  important  step  in  gaining  insight  into  how  to  make  better  IT  investment  decisions  and 
effectively  managing  the  risk  involved  in  committing  limited  DON  financial  and  human 
resources. 

B.  PURPOSE 

The  purpose  of  this  study  is  to  describe  a  methodology  for  using  ROM  with  ITPM 
to  manage  financial  risks  involved  in  DON  IT  investment  decisions.  A  secondary  goal  of 
this  study  is  to  develop  a  model  for  utilizing  ROM  within  the  Portfolio  Management 
framework  for  managing  risks  associated  with  investment  decisions  including,  but  not 
exclusive  to,  information  technology  investments. 

C.  ASSUMPTIONS  AND  LIMITATIONS 

IT  Portfolio  Management  has  been  adopted  as  the  method  required  for  IT 
investment  and  management  in  the  government  sector  as  a  result  of  legislation  such  as  the 
Clinger- Cohen  Act  and  the  Government  Performance  and  Results  Act.  The  ROM- ITPM 
methodology  proposed  in  this  study  as  well  as  the  example  presented  in  this  study 
assumes  ITPM  has  been  implemented.  Specifically,  this  study  uses  the  ITPM 
implementation  as  outlined  in  the  NAVSUP  Portfolio  Management  Concept  of 
Operations  because  it  incorporates  the  best  practices  from  ITPM  implementations  across 
the  government  sector.  Using  this  best  of  breed  implementation  of  ITPM  provides  the 
unique  opportunity  to  demonstrate  how  the  proposed  ROM-ITPM  methodology  can 
contribute  valuable  information  not  available  through  current  ITPM  investment  analysis 
tools. 

This  thesis  does  not  attempt  to  assess  the  validity  of  ITPM  or  the  quality  of 
NAVSUP’ s  employment  of  ITPM.  Instead,  this  thesis  will  address  managing  investment 
risks  within  the  DON’S  ITPM  framework  using  ROM.  The  example  presented  in  this 
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study  is  provided  only  to  illustrate  the  usefulness  of  the  ROM-ITPM  methodology  as  an 
additional  tool  for  making  IT  investment  decisions  and  managing  the  financial  risks 
associated  with  these  investment  decisions. 

D.  SCOPE  OF  STUDY 

Specifically,  this  thesis  will  define  ROM  and  ITPM  including  a  brief  review  of 
where  and  how  these  tools  have  been  used.  The  initial  discussion  of  ITPM  will  be 
followed  by  a  discussion  of  how  ITPM  is  currently  being  employed  by  NAVSUP.  ROM 
will  be  discussed  as  a  primary  means  for  dealing  with  strategic  investment  financial  risks 
paying  particular  attention  to  how  ROM  differs  from  historical  methods  such  as  DCF, 
decision  tree  analysis  aid  NPV.  Finally,  this  thesis  will  draw  upon  how  ROM  is 
currently  being  employed  in  other  industries  and  utilize  a  NAVSUP  IT  capital  investment 
example  to  illustrate  the  potential  benefits  and  limitations  of  applying  ROM  in  the  DON. 


E.  RESEARCH  METHODOLOGY 

1.  Literature  Review 

The  methodology  included  a  review  of  pertinent  legislation  such  as  the  Clinger- 
Cohen  Act,  Paperwork  Reduction  Act  of  1995,  Government  Performance  and  Results  Act 
of  1993,  and  OMB  Circular  A 130.  A  review  of  literature  related  to  government  ITPM 
implementations  such  as  those  done  by  the  Departments  of  Veterans  Affairs,  Housing 
and  Urban  Development  (HUD),  Transportation  (DOT),  Naval  Supply  Systems 
Command  (NAVSUP)  and  Defense  Logistics  Agency  (DLA)  was  conducted  to  identify 
best  practices  and  select  a  best  of  breed  ITPM  implementation.  Finally,  the  literature 
review  included  scholarly  articles  and  texts  related  to  IT  investment  strategies, 
application  of  Real  Options  in  the  private  sector,  and  the  software  tools  currently  used  for 
these  purposes. 

2.  Data  Collection 

Data  collection  included  a  review  of  documented  procedures,  interviews  with  key 
personnel  involved  in  ITPM,  and  data  available  from  applicable  business  case  analyses 
for  the  project  selected  to  illustrate  the  ROM-ITPM  methodology.  The  financial  data 
utilized  in  this  study  was  based  on  business  case  estimates  as  well  as  estimates  from 
knowledgeable  project  management  personnel.  The  financial  data  used  in  this  study  are 
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for  illustrative  purposes  only  and  are  not  intended  to  be  utilized  as  an  optimal  solution  to 
a  specific  scenario. 

F.  BENEFITS  OF  STUDY 

IT  investments  make  up  a  significant  portion  of  the  Navy  budget.  Therefore, 
making  sound  IT  investment  decisions  and  managing  the  risks  involved  in  those 
decisions  is  paramount.  The  importance  of  effectively  managing  IT  investments  has 
attracted  significant  attention  from  both  Congress  and  the  White  House  over  the  past 
several  years.  In  response  to  their  concerns,  Congress  passed  the  Clinger-Cohen  Act  of 
1996  to  “establish  processes  and  have  information  in  place  to  ensure  that  IT  projects  are 
being  implemented  at  acceptable  cost,  within  reasonable  and  expected  time-frames,  and 
are  contributing  to  tangible,  observable  improvements  in  mission  performance”  (DON 
2001a).  The  Federal  CIO  and  DON  CIO  have  responded  by  issuing  a  series  of  reports 
designating  ITPM  as  the  mechanism  that  will  be  used  to  achieve  the  goals  of  Clinger- 
Cohen.  Although  ITPM  provides  a  cogent  process  for  selecting,  managing  and 
evaluating  IT  investments,  it  is  limited  in  its  ability  to  manage  the  risks  involved  in  the 
selection  and  evaluation  phases  of  the  process.  The  success  of  ROM  as  a  mechanism  for 
managing  risk  in  the  volatile  pharmaceutical  R&D  and  petroleum  exploration  industries 
has  created  interest  in  the  application  of  ROM  to  IT  investment  decisions.  This  study 
will  provide  an  analysis  of  the  usefulness  of  incorporating  ROM  into  ITPM  as  a 
mechanism  for  addressing  the  financial  risks  inherent  in  IT  investment  decisions.  The 
success  of  ROM  in  the  arena  of  IT  investments  can  provide  far-reaching  benefits  to 
managers  attempting  to  balance  the  risks  of  IT  investments  with  the  competing  demands 
on  scarce  financial  and  human  resources.  This  study  seeks  to  address  these  concerns  by 
explicitly  analyzing  the  usefulness  of  ROM  in  addressing  IT  investment  risks  within  the 
framework  of  ITPM. 

The  viability  of  ROM  as  a  risk  management  tool  in  government  may  be  far 

reaching.  In  fact,  in  a  recent  article  Commander  Greg  Glaros  of  the  Office  of  Force 

Transformation  has  offered  ROM  as  a  possible  tool  for  evaluating  new  DOD  programs. 

However,  the  major  issue  that  is  faced  when  dealing  with  projects  in  government  is 

related  to  purpose,  time  and  amount  (PTA)  restrictions.  Projects  are  defined  and  funded 

based  on  available  funding.  The  established  funding  (amount)  can  only  be  used  for  the 
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intended  purposes  set  forth  in  the  appropriation  (purpose)  and  is  only  available  for  the 
duration  of  that  appropriation  (time).  Although  PTA  restrictions  present  a  challenge, 
ROM  provides  a  financial  tool  that  can  evaluate  multiple  strategic  pathways  present  in 
the  changing  global  landscape.  If  ROM  is  demonstrated  to  be  a  viable  method  of 
managing  IT  investment  risks,  this  method  can  be  applied  to  IT  and  other  strategic 
investments  across  DON  and  other  government  agencies  in  the  foreseeable  future. 

G.  ORGANIZATION  OF  PAPER 

Chapter  I  begins  by  introducing  the  reader  to  the  dilemma  the  Department  of  the 
Navy  currently  faces  with  regard  to  managing  financial  risks  associated  with  IT 
investment  decisions.  This  background  information  is  followed  by  an  explanation  of  the 
significance  of  this  study  including  future  application  to  strategic  investment  decisions 
throughout  government. 

Chapter  II  begins  by  defining  ITPM  and  describing  ho  w  it  came  to  be  the  method 
used  by  government  for  making  IT  investment  decisions.  This  explanation  is  followed  by 
a  brief  coverage  of  how  ITPM  is  currently  being  implemented  within  DON  and  the 
challenges  still  facing  DON  managers  with  regard  to  managing  IT  investment  risks. 

Chapter  III  introduces  ROM  as  a  potential  method  of  managing  risks  associated 
with  IT  investments.  This  chapter  defines  ROM  and  describes  how  it  works  as  well  as 
how  it  can  be  incorporated  into  ITPM  to  manage  financial  risks  associated  with  IT 
investments.  Chapter  III  concludes  by  presenting  a  proposed  model  for  using  ROM 
within  the  ITPM  framework  to  manage  risk. 

Chapter  IV  provides  an  example  of  how  ROM  can  be  employed  in  ITPM  to 
address  risk.  The  chapter  begins  with  an  explanation  of  Naval  Supply  Systems 
Command  (NAVSUP)  Automatic  Identification  Technology  (AIT),  which  will  be  used  to 
demonstrate  the  viability  of  ROM  in  managing  risk.  The  chapter  goes  on  to  identify  the 
usefulness  of  ROM  based  on  the  AIT  example. 

Finally,  Chapter  V  provides  a  summary  of  this  study  including  a  discussion  of  the 
proposed  ROM-ITPM  methodology  for  addressing  risk.  The  broader  implications  of  this 
study  are  discussed  focusing  on  recent  proposals  by  the  DOD  Office  of  Force 
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Transformation  to  apply  ROM  to  PPBE.  Chapter  V  concludes  with  recommendations  for 
future  research  based  on  the  findings  of  this  study. 
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n.  MANAGING  IT  INVESTMENTS  WITH  ITEM 


A.  IMPETUS  FOR  IT  PORTFOLIO  MANAGEMENT  (ITPM) 

Programming  and  budgeting  in  DOD  determines  how  scarce  resources  will  be 
allocated.  Major  increases  or  decreases,  in  the  current  system,  are  rarities  with  most 
changes  occurring  incrementally.  This  incremental  change  is  the  result  of  the  methodical 
Planning,  Programming,  Budgeting  and  Execution  System  (PPBES)  used  to  determine 
which  programs  are  funded  within  DOD  and  at  what  level.  Unfortunately,  the  incredibly 
rapid  pace  of  change  in  the  world  of  IT  creates  a  dilemma  for  those  who  are  charged  with 
determining  how  these  finds  are  invested.  Particularly  difficult  is  determining  what  to 
invest  in,  how  much  to  invest,  how  to  evaluate  investments,  and  how  to  increase  return  on 
investments.  Answering  these  questions  becomes  more  important  as  the  cost  of  IT 
investments  continues  to  rise  and  financial  resources  become  more  constrained. 

Over  the  years,  the  Department  of  the  Navy  (DON)  has  learned  just  how  elusive 
the  answer  to  the  IT  investment  question  can  be.  Recent  investments  in  the  Navy  Marine 
Corps  Intranet  (NMCI)  and  the  funding  of  Enterprise  Resource  Planning  (ERP)  pilots 
have  raised  significant  questions  surrounding  how  IT  proposals  are  reviewed  and  selected 
(Capaccio  2003).  The  business  world  is  experiencing  similar  troubles  in  dealing  with  the 
IT  investment  dilemma.  The  business  world  is  littered  with  examples  of  major 
corporations  making  significant  IT  investments  that  proved  nearly  fatal  because  of  poor 
selection  or  flawed  execution/implementation  of  IT  solutions.  Eor  example,  Hershey’s 
flawed  implementation  of  a  $11 5M  Enterprise  Resource  Planning  (ERP)  system  resulted 
in  an  18.6%  decrease  in  earnings  during  its  busiest  quarter  of  the  year  (Osterland  2001). 
In  spite  of  estimates  that  returns  from  some  new  technology  would  be  substantial,  in 
some  cases,  these  pay-offs  have  been  few  and  far  between.  In  fact,  some  of  these 
corporations  have  reverted  to  previous  systems  and  cut  their  losses  as  their  hopes  for 
gaining  a  competitive  advantage  using  costly  IT  systems  have  been  dashed  due  to  flawed 
implementation  and  poor  selections  of  IT  solutions.  Not  all  corporations  were  so 
unfortunate.  Companies  like  Wal-Mart  and  Dell  have  effectively  used  IT  solutions  to 
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improve  supply  chain  management  and  gain  a  significant  competitive  advantage  while 
meeting  the  needs  of  their  customers  (Afuah  and  Tucci  2001). 

The  problems  DON  faces  with  regard  to  selecting,  managing  and  evaluating  IT 
solutions  are  common  to  all  government  agencies.  The  potential  for  waste  caused  by 
these  shortcomings  has  attracted  the  attention  of  Congress.  Aware  of  the  significant 
benefits  to  be  derived  from  effective  selection  and  implementation  of  IT  solutions. 
Congress  passed  legislation  to  promote  the  use  of  IT  to  reduce  the  cost  of  government 
operations,  e.g.,  the  Paperwork  Reduction  Act  of  1995.  This  legislation  required  that  all 
government  agencies  define  program  information  needs,  develop  an  information 
resources  management  (IRM)  plan,  and  integrate  the  IRM  within  the  organization.  This 
plan  was  to  be  “integrated  with  organizational  planning,  budget,  financial  management, 
human  resources  management  and  program  decisions”  (DON  2001a).  The  Clinger- 
Cohen  Act  of  1996  further  shifted  the  momentum  in  government  towards  identifying  a 
systematic  mechanism  for  selection,  management  and  evaluating  IT  solutions. 

B.  IT  PORTFOLIO  MANAGEM  ENT 

The  government,  and  DON  specifically,  has  looked  to  the  commercial  sector  to 
identify  a  model  for  making  IT  investment  decisions,  implementing  IT  solutions  and 
evaluating  the  return  on  investment.  The  Federal  Chief  Information  Officer  (CIO)  has 
since  identified  ITPM  as  the  mechanism  by  which  IT  investments  are  selected,  managed 
and  evaluated.  The  Federal  CIO  has  defined  ITPM  as  a  system  for  evaluating,  selecting, 
prioritizing,  budgeting  and  planning  for  investments  that  provide  the  greatest 
value/contribution  to  an  organization  (Federal  CIO  Council  2002).  Over  the  past  several 
years,  the  DON  CIO  Council  has  defined  ITPM  within  DON  using  three  major  reports: 
(1)  DON  IT  Investment  Portfolio  Model,  (2)  DON  IT  Capital  Investment  Guide,  and  (3) 
DON  IT  Portfolio  Management  Benchmark  Report.  Although  these  studies  differ  in  their 
scope  and  focus,  they  each  provide  valuable  insight  into  ITPM. 

1.  DON  IT  Investment  Portfolio  Model 

The  first  major  document  produced  by  DON  was  the  DON  IT  Investment 
Portfolio  Model  drafted  by  the  Investment  Practices  Integrated  Process  Team  back  in 
1999.  This  document  is  relatively  narrow  in  scope  but  provides  a  three-phase  framework 

for  IT  investment:  Selection,  Management,  and  Evaluation.  Figure  1  provides  a 
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graphical  representation  of  this  three-phase  process  (DON  1999).  During  the  Selection 
Phase,  criteria  are  established,  and  then  projects  are  screened,  documented,  reviewed, 
prioritized  and  selected.  Once  the  project  is  selected,  the  Management  Phase  begins. 
During  this  phase,  managers  must  utilize  objective  criteria  for  evaluating  projects  based 
on  careful  monitoring.  Managers  are  then  involved  in  identifying  problems  and 
implementing  corrective  actions  that  improve  the  project.  Finally,  in  the  evaluation 
phase,  the  project  is  reviewed  to  assess  whether  the  actual  performance  matches  the 
expected  performance  and  if  intended  objectives  are  met.  Decisions  must  be  made  at  this 
point  regarding  required  improvements/modifications  or  whether  a  new  project  is  needed 
to  meet  the  objectives. 


Capital  Planning  Phases: 

Select,  Manage,  Evaluate 


This  model  focuses  primarily  on  the  "Select"  phase  of  Capital 
■  Planning.  The  portfolio  investment  model  also  addresses  the 
"Management"  and  "Evaluate" phases. 


Select 

IT  Investment 
Funding  Decisions 


Information  Flow 


Manage 

Decisions  to  continue, 
N  modify,  or  terminate 


Evaluate 

Feedback  based  on 
post-deployment  reviews, 
^  lessons  learned 


Figure  1.  Capital  Planning  Phases  from  (DON  1999). 


Although  each  of  the  three  phases  discussed  in  this  document  are  important,  the 
Selection  Phase  is  the  most  difficult  and  the  most  critical.  During  this  phase,  managers 
make  important  tradeoffs  regarding  risks  and  returns  that  affect  the  rest  of  the  process. 
These  risks  can  be  as  basic  as  assessing  the  affordability  and  reliability  of  a  system  or 
may  be  extremely  elusive  as  in  the  case  of  identifying  the  degree  of  information 
assurance  and  system  security  required.  Although  light  discussion  is  given  to  these 
topics,  DON  IT  Investment  Portfolio  Model  does  not  go  into  significant  detail  regarding 
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how  this  should  be  done.  Nonetheless,  this  type  of  analysis  is  provided  in  detail  in  the 
second  major  report,  the  DON  IT  Capital  Investment  Guide. 

2.  DON  IT  Capital  Investment  Guide 

Introduced  by  the  DON  CIO  in  April  2001,  the  DON  IT  Capital  Investment  Guide 
begins  with  a  reiteration  of  the  basic  three-phase  portfolio  model  discussed  above.  The 
document  goes  on  to  describe  the  legislation  and  policy  that  has  served  as  a  major 
impetus  for  instituting  ITPM.  The  most  significant  of  these  is  the  Clinger-Cohen  Act  of 
1996.  Clinger-Cohen’ s  goal  is  to  establish  processes  for  ensuring  IT  projects  that  are 
implemented  meet  cost  objectives  and  demonstrate  tangible  benefits.  Figure  2  details 
some  of  the  specific  requirements  laid  out  in  Clinger-Cohen  (DON  2001a).  Other 
legislation  and  policy  such  as  the  Paperwork  Reduction  Act  of  1995,  Government 
Performance  and  Results  Act  of  1993  and  OMB  Circular  A- 130  similarly  stress  the  need 
for  process  improvements  in  government  centered  on  technology  and  managing 
investments.  Executive  Order  13011,  issued  by  the  Clinton  Administration,  reinforced 
these  requirements. 

The  most  useful  feature  of  the  DON  IT  Capital  Investment  Guide  is  the  degree  of 
detail  it  offers  in  connecting  relationships  among  the  IT  Capital  Planning  Process, 
Acquisition  Program  Process  and  the  Planning  Programming  and  Budgeting  System 
(PPBS).  This  feature  of  the  document  provides  a  more  complete  picture  of  the 
implications  of  an  effective  IT  Capital  Planning  Process  such  as  ITPM. 

*  Selection,  management  and  evaluation  of  IT  investments; 

^  Integrated  with  the  processes  for  making  budget,  financial  and  program  management  decisions; 

*  Bases  IT  investment -funding  decisions  on  minimum  criteria,  which  facilitate  the  comparison  and  prioritization  of 
competing  IT  investment  alternatives; 

^  Provides  for  the  identification  of  investments  with  potential  benefits  to  other  governmental  agencies; 

Provides  for  the  identification  of  measurements  which  quantify  the  risks  and  benefits  of  the  investment  to  the 
mission  or  business  area;  and 

*  Provides  the  means  for  Agency  management  personnel  to  obtain  timely  information  regarding  the  progress  of  the  IT 
investment  including  the  status  of  meeting  specified  milestones  in  terms  of  cost,  schedule,  quality,  etc. 

Figure  2.  Provisions  of  Clinger-Cohen  Act  of  1996  from  (DON  2001a). 

Established  by  former  Secretary  of  Defense  Robert  McNamara  in  1962,  PPBS 

assists  the  Secretary  of  Defense  in  resource  allocation  decisions  among  numerous 
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competing  programs.  The  PPBS  systematically  translates  strategies  into  we  11- formulated 
requirements  and  programs  that  are  incorporated  into  the  President’s  budget  submission. 
PPBS  has  recently  been  renamed  the  Planning,  Programming,  Budgeting  and  Execution 
System  (PPBES)  to  reflect  a  growing  sentiment  that  more  emphasis  needs  to  be  placed  on 
execution  of  the  budget  (Wolfowitz  2003).  ITPM  links  to  the  planning  and  budgeting 
phases  of  PPBES  by  providing  a  mechanism  for  selecting  programs  that  fit  established 
plans  and  evaluating  existing  programs  already  included  in  the  budget. 

The  Acquisition  Program  Process  is  described  by  outlining  the  different 
Acquisition  Categories  (ACAT)  into  which  IT  programs  may  be  placed  based  on  total  life 
cycle  cost  and  complexity.  The  DON  acquisition  process  for  IT  investments  is  governed 
by:  (I)  DOD  Directive  5000.1,  “The  Defense  Acquisition  System”  of  May  03;  (2)  DOD 
Instruction  5000.2,  “Operation  of  the  Defense  Acquisition  System”  of  May  03;  and  (3) 
SECNAVINST  5000.2B  of  Dec  96  (DON  2001).  The  Acquisition  Program  Process 
provides  guidance  for  establishing  milestones,  decision-making  levels,  and  appropriate 
documentation  of  milestones.  Based  on  size,  complexity  and  risk,  this  process  designates 
programs  as  falling  into  one  of  four  categories:  ACAT  lA,  ACAT  II,  ACAT  III,  and 
ACAT  IV.  Each  ACAT  provides  for  a  different  level  of  management  attention  designed 
to  facilitate  successful  program  management.  This  process  is  closely  linked  to  the  ITPM 
selection  and  management  phases.  Figures  3  and  4  describe  these  processes  and  the 
relationships  that  exist  among  them  (DON  200 1  a).  i 


1  The  processes  referenced  in  this  instruction  have  recently  been  revised  (e.g.  PPBE).  However,  the 
basic  relationship  existing  between  these  processes  and  the  IT  Portfolio  Management  process  is  the  same. 
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Figure  3.  Acquisition  Program,  IT  Capital  Planning  and  PPBES  Relationships  from  (DON 

2001a). 
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Figure  4.  PPBES  and  DON  IT  Capital  Planning  from  (DON  2001a). 


Also  discussed  are  important  concepts  such  as  evaluating  the  acceptability  of 
commercial  off-the-shelf  (COTS)  solutions.  The  roles  of  Program  Managers  (PMs)  and 
Milestone  Decision  Authorities  (MDAs)  are  discussed  in  terms  of  responsibilities  to 
monitor  programs  and  determine  whether  major  milestones  have  been  achieved  in  the 
execution  of  a  program.  This  document  also  provides  a  cogent  explanation  of  the 
relationship  between  PPBES  and  IT  Capital  Planning  that  is  also  extremely  useful  in 
developing  a  better  understanding  of  the  process. 

Finally,  the  DON  IT  Capital  Investment  Guide  provides  significant  discussion  of 
methods  of  measuring  and  evaluating  performance  of  projects.  These  performance 
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measures  occur  at  the  Enterprise,  Functional  and  Infrastructure  Levels.  In  this  scenario. 
Enterprise  Level  involves  evaluation  of  projects  based  on  outcomes  and  conformance  to 
IT  strategic  plans/initiatives.  The  Functional  Level  includes  evaluations  based  on 
measuring  how  useful  outcomes  are  at  the  functional  or  business  level.  Cost  and 
efficiency  are  common  evaluative  criteria  at  the  Functional  Level.  Infrastructure  Level, 
in  contrast,  is  based  on  evaluation  of  programs  based  on  shared  utility  such  as  Local  Area 
Networks  (LANs)  or  Wide  Area  Networks  (WANs).  Measures  in  this  case  tend  to  focus 
on  technical  outputs  like  interconnectivity,  bandwidth  and  infrastructure  support  that 
serve  as  a  pseudonym  for  customer  satisfaction. 

3.  DON  IT  Portfolio  Management  Benchmark  Report 

The  final  major  document  is  the  DON  IT  Portfolio  Management  Benchmark 
Report,  which  was  introduced  in  July  2001.  This  moves  from  the  realm  of  theory  to 
review  the  practical  application  of  ITPM  in  selected  organizations  to  provide  lessons  and 
examples  to  facilitate  DON  implementation  of  ITPM.  The  report  reviews  the  ITPM 
efforts  of  U.S.  Departments  of  Housing  and  Urban  Development  (HUD),  Veteran’s 
Affairs  (VA),  Agriculture  (USDA),  and  General  Services  Administration  (GSA).  ITPM 
implementations  in  each  of  these  organizations  are  reviewed  in  terms  of  the  three  major 
phases:  Selection,  Management  and  Evaluation.  In  addition,  ongoing  efforts  at  major 
DON  organizations  like  NAVAIR  and  NAVSEA  are  reviewed  along  with  lessons  learned 
from  their  implementations.  These  reviews  of  ITPM,  both  internal  and  external  to  DON, 
provide  valuable  insight  and  lessons  from  which  other  organizations  can  base  their 
implementations. 

The  document  also  provides  a  valuable  discussion  of  ITPM  Tools  that  are 
currently  being  used  in  the  government  and  commercial  sector.  These  tools  include 
Information  Technology  Portfolio  Management  System  (I- TIPS®),  Expert  Choice®, 
NITE/STAR®,  ProSight®,  and  Crystal  Reports®  to  name  a  few,  along  with  points  of 
contact  for  these  tools.  These  tools  are  decision  support  tools  that  allow 
managers/decision  makers  to  systematically  compare  alternatives  and  make  decisions 
based  on  those  comparisons.  Systems  like  I- TIPS®  and  Expert  Choice®  are  commercial 
systems  that  provide  flexibility  in  facilitating  group  collaboration/decisions. 
Organizations  like  the  Department  of  Housing  and  Urban  Development  (HUD)  and  the 
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Department  of  Veterans  Affairs  (VA)  use  these  systems.  DON  has  instead  selected  the 
NITE/STARS  system  as  the  system  of  choice.  This  Navy  system  provides  some 
flexibility  but  was  selected  because  it  “provides  all  levels  of  DON,  with  an  efficient 
means  of  capturing,  consolidating,  maintaining,  reporting  and  distributing  Information 
Technology  (IT)  and  National  Security  Systems  (NSS)  budget  and  Program  Objectives 
Memoranda  (POM)  Tab  G  [information  technology]  resources  information”  (DON 
2001b).  The  DON  IT  Portfolio  Management  Benchmark  Report  provides  a  practical 
guide  that  serves  as  a  blueprint  for  implementing  ITPM  in  DON.  Each  of  the  three  major 
DON  documents  discussed  above  provides  valuable  information  for  implementing  ITPM. 
Projects  like  Enterprise  Resource  Planning  (ERP)  and  Navy  and  Marine  Corps  Intranet 
(NMCI)  are  providing  opportunities  for  DON  to  demonstrate  how  well  it  is  incorporating 
the  lessons  and  processes  of  ITPM. 

C.  IT  INVESTMENT  SELECTION  AND  EVALUATION  PROCESSES 

Selection  and  evaluation  of  IT  investments  has  become  increasingly  important  in 
government  as  organizations  embark  on  an  ambitious  path  to  transformation  or  reinvent 
government.  The  availability  of  powerful  enabling  technologies  has  presented 
tremendous  opportunities  among  which  managers  must  choose  due  to  limitations  in  the 
availability  of  financial  and  personnel  resources.  Recognition  of  this  important  fact  has 
led  to  the  incorporation  of  ITPM  to  aid  in  the  selection  and  evaluation  processes. 

1.  DON  Framework 

Selection  and  evaluation  processes  involve  the  careful  weighing  of  the  benefits, 
costs,  relevance  to  mission,  and  risks  of  potential  investments  for  the  purpose  of  making 
funding  decisions.  New  proposals  are  presented  in  the  form  of  a  business  case  that 
identifies  the  organization  need  that  will  be  met  by  the  investment  and  provides  a  method 
for  comparing  competing  investments.  Comparisons  are  then  made  based  on  established 
common  criteria  allowing  funding  sponsors  to  make  decisions  based  on  the  relative  merit 
and  affordability  of  the  projects.  This  DON  framework  relies  heavily  on  standard 
methods  such  as  net  present  value  (NPV)  and  return  on  investment  (ROI).  Typically, 
these  measures  are  used  as  thresholds  that  provide  a  control  limit  for  determining  which 
projects  will  be  considered.  For  instance,  the  DON  IT  Capital  Planning  Guide 
establishes  that  projects  must  have  an  ROI  greater  than  one  (1.0)  to  be  considered.  This 
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guide  goes  on  to  point  out  that  “...it  is  expected  that  all  IT  investments  will  produce 
either  savings/cost  avoidances  or  performance  improvements  and  that,  as  a  minimum, 
one  of  the  two  is  required  for  funding  approval”  (DON  2001a).  This  concept  is 
reinforced  by  legislation  such  as  Clinger-Cohen  Act  of  1996,  Executive  Order  13011  and 
OMB  Circular  A-11.  Consequently,  the  burden  of  demonstrating  that  current  and 
proposed  IT  investments  meet  established  ROI  criteria  significantly  affects  how 
managers  view  potential  investments. 

2.  Current  NAVSUP  Process 

The  Naval  Supply  Systems  Command  (NAVSUP)  is  responsible  for  delivering 
information,  material,  services  and  quality  of  life  products  to  U.S.  Naval  Forces  across 
the  globe.  NAVSUP  is  organized  into  ten  geographically  dispersed  field  activities 
assigned  to  seven  Assistant  Chiefs  of  Staff  (ACOS).  This  arrangement  is  designed  to 
align  the  NAVSUP  organization  to  its  diverse  customer  base:  Operating  Forces  (OFS), 
Operational  Commanders  (OCS),  Navy  Family  Support  (NFS),  Regional  Commander 
Support  (RCS),  International  Logistics  (ILS),  Acquisition  (AS)  and  Industrial  Support 
(IS). 

The  NAVSUP  process  is  of  particular  interest  because  their  specific  application  of 
ITPM  will  be  the  backdrop  to  the  illustration  of  ROM  implementation  presented  in  this 
study.  A  review  of  their  current  process  establishes  a  context  for  the  proposed  ROM- 
ITPM  methodology  introduced  in  the  pages  that  follow.  For  the  purposes  of  this  study,  it 
is  assumed  that  the  NAVSUP  implementation  of  ITPM  is  consistent  with  the  procedures 
contained  in  their  Portfolio  Management  Concept  of  Operations.  The  NAVSUP 
implementation  of  ITPM  fits  well  within  the  guidelines  prescribed  by  the  Federal  Chief 
Information  Officer  (CIO)  and  DON.  NAVSUP  has  further  defined  Portfolio 
Management  as  “a  disciplined,  structured,  and  repeatable  approach  to  assist  decision 
makers  in  aligning  their  information  technology  investments  with  the  organization’s 
business  needs  to  achieve  measurable  improvements  in  the  overall  mission  outcome” 
(NAVSUP  2003a).  After  reviewing  the  ITPM  implementations  by  agencies  like  the 
HUD,  VA,  USDA  and  GSA,  NAVSUP  was  selected  as  the  backdrop  in  this  study 
because  it  represents  a  balanced  approach  to  ITPM  that  reflects  many  of  the  best  practices 
of  the  aforementioned  agencies.  In  fact,  the  NAVSUP  CONOPS  has  been  written  to 
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incorporate  these  best  practices  (Lattig  and  Spiegel  2003).  Yet,  as  we  shall  see  later, 
using  the  ROM-ITPM  methodology  can  provide  additional  insights  even  for  this  best  of 
breed  implementation. 

Portfolio  Management  at  NAVSUP  is  one  subset  of  an  overall  IT  management 
life  cycle.  Figure  5  illustrates  how  the  IT  Investment  Plan,  IT  Architecture,  IT 
Enterprise  Plan  and  ITPM  are  woven  to  ensure  alignment  with  the  organization’s 
business  strategy  (NAVSUP  2003a).  NAVSUP’s  Portfolio  Management  process  moves 
authority  to  make  investment  decisions  from  the  headquarters  comptroller  to  the  Chief 
Information  Officer  (CIO)  and  cognizant  Assistant  Chiefs  of  Staff  (ACOS)  responsible 
for  the  process  supported  by  the  IT  investment.  The  CIO  is  responsible  for  “IT  visioning, 
planning,  policy  development,  resource  allocation,  and  Transformation  savings 
attainment”  (NAVSUP  News  2003).  The  headquarters  comptroller,  primarily  responsible 
for  allocating  and  managing  financial  resources  in  accordance  with  organization 
objectives,  has  now  turned  over  IT  decisions  to  an  executive  focused  on  making  sound 
strategic  investments  in  IT. 


IT 


Figure  5.  NAVSUP  IT  Management  Process  from  (NAVSUP  2003a). 

NAVSUP’s  IT  investment  decision-making  process  is  facilitated  by  the  Corporate 
Project  Management  System  (CPMS).  A  centerpiece  of  the  NAVSUP  process,  CPMS 
automates  the  flow  of  proposals  for  in-house  IT  solutions  and  the  review  of  competing 
project  proposals.  This  automated  system  facilitates  information  exchanges  among  the 
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major  elements  of  the  NAVSUP  organization:  the  ACOS,  the  Architectural  Review 
Board  (ARB)  and  the  Investment  Review  Board  (IRB).  In  this  process,  the  ACOS 
determines  if  the  project  is  a  sound  investment  based  on  a  preliminary  package  provided 
by  the  Navy  Supply  Information  Systems  Activity  (NAVSISA)  Portfolio  Management 
staff.  2  CPMS  incorporates  ACOS  reviews,  and  uses  commercial  software  solutions  such 
as  ProSight®  and  Primavera®  for  portfolio  management  and  project  management 
respectively.  The  reviews  formalized  by  CPMS  pose  a  series  of  questions  that  guide 
investment  decisions  for  the  NAVSUP  organization.  The  ACOS  is  asked  to  answer 
questions  designed  to  identify  project  significance,  verify  a  problem  exists,  determine 
adequacy  of  project  solution,  verify  savings,  and  determine  other  impacts  such  as  the  cost 
or  impact  to  other  organizations. 

The  ACOS  review  mentioned  above  provides  an  initial  assessment  of  strategic  fit 
of  the  project  including  feasibility  and  the  need  for  the  capabilities  provided  by  the 
project.  If  approved  by  the  ACOS,  the  ARB  then  determines  the  technical  requirements 
for  the  project.  In  this  arrangement,  the  ARB  is  primarily  responsible  for  evaluating  the 
technical  aspects  of  proposed  projects  such  as  hardware  specifications,  coding  and 
interfaces.  The  ARB  “has  authority  over  all  technical  decisions”  (NAVSUP  2003a). 
Once  the  ACOS  and  ARB  reviews  are  completed,  the  results  of  their  reviews  are 
recorded  in  CPMS  and  the  IRB  review  begins.  During  the  IRB  review  the  project  is 
scored  using  an  established  scoring  system  designed  to  compare  and  assess  projects. 

The  IRB  is  convened  to  monitor  existing  projects,  new  projects  and  make 
decisions  regarding  the  need  to  terminate  failing  projects.  The  IRB  is  made  up  of 
NAVSISA  and  NAVSUP  staff  designated  to  bring  together  the  inputs  from  the  cognizant 
ACOS  and  ARB  to  score  the  project  based  on  risk,  organizational  impact,  strategic 
alignment,  mission  effectiveness  and  benefit-cost  impact.  Based  on  this  final  scoring,  a 
decision  to  include  or  exclude  a  project  is  made  by  the  CIO  and  ACOS  who  make  up  the 
Corporate  Board. 

This  process  is  spelled  out  in  its  entirety  in  the  NAVSUP  Portfolio  Management 
Concept  of  Operations.  This  discussion  of  the  process  is  offered  to  illustrate  the  balanced 

2  NAVSISA  provides  the  information  technology  expertise  within  the  NAVSUP  claimancy  headed  by 
the  ACOS  for  Information  Support. 
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approach  used  at  NAVSUP  and  provide  the  reader  a  frame  of  reference  for  the  example 
and  discussion  that  follows.  The  NAVSUP  Portfolio  Management  process  seeks  to 
address  important  issues  such  as  determining  what  to  invest  in,  how  much  to  invest,  how 
to  evaluate  investments  and  how  to  increase  return  on  investments.  However,  even  this 
best  of  breed  alternative  is  lacking.  Its  reliance  on  traditional  discounted  cash  flow  does 
not  factor  in  the  flexibility  managers  have  when  making  strategic  investments  to  wait, 
expand,  or  abandon  as  more  information  becomes  available.  Uncertainty  and  financial 
risks  associated  with  investments  are  not  addressed  with  the  analytical  rigor  available 
through  the  Real  Options  Method.  This  study  seeks  to  present  a  new  methodology  using 
the  Real  Option  Method  that  will  allow  managers  to  leverage  investment  risk  and  exploit 
opportunities  created  by  risk  and  uncertainty. 
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m.  THE  ROM-ITPM  FRAMEWORK 


A.  ROM  AND  UNCERTAINTY 

Inherent  in  all  business  decisions  is  a  careful  balancing  of  risk  versus  reward. 
Most  managers  view  the  uncertainty  that  exists  in  strategic  investment  decisions  as 
something  to  avoid,  but  also  understand  that  higher  risk  is  also  associated  with  higher 
reward.  Over  the  past  several  decades,  managers  have  looked  to  different  tools  to  help 
them  make  critical  investment  decisions  that  often  meant  the  difference  between 
sustaining/achieving  competitive  advantage  and  becoming  irrelevant.  Discounted  Cash 
Flow  (DCF),  Net  Present  Value  (NPV)  and  decision  tree  analysis  have  been  the 
traditional  methods  for  evaluating  these  investment  decisions.  Each  of  these  measures 
provides  important  information  that  allows  managers  to  make  comparisons  among 
competing  investment  choices.  Unfortunately,  these  methods  fail  to  account  for  the 
iterative  nature  of  real  world  decisions.  These  methods  treat  investment  decisions  as  a 
static  process  assuming  away  management’s  ability  to  alter  decisions  as  conditions 
change.  This  hardly  reflects  the  true  complexity  of  IT  capital  investment  decisions.  In 
reality,  every  capital  investment  decision  is  based  on  a  series  of  options.  Managers  can 
elect  to  “defer  additional  work,  abandon  it  outright,  shut  it  down  and  restart  later,  expand 
it,  trim  it  back,  or  even  switch  its  strategic  purpose”  (Alleman  2000).  ROM  provides  a 
framework  to  address  this  real  world  scenario. 

1.  What  is  an  Option? 

An  option  can  be  defined  as  “the  right,  but  not  the  obligation,  to  take  an  action  in 
the  future”  (Amran  and  Kulatilaka  1999).  A  financial  option  allows  the  owner  to  sell 
(put)  or  buy  (call)  a  stock  at  a  given  price  within  an  established  period  of  time.  The  key 
is  that  there  is  no  obligation  to  actually  sell  or  buy.  If  the  option  is  never  exercised  the 
owner  of  the  option  loses  only  the  cost  of  the  option,  yet  the  potential  for  gain  remains 
high.  It  stands  to  reason  that  the  owner  of  the  option  will  only  choose  to  exercise  the 
option  to  buy  or  sell  when  conditions  are  favorable.  Therefore  the  greater  the  uncertainty 
associated  with  an  option,  the  greater  the  value  of  that  option.  The  following  are  terms 
associated  with  options  that  are  also  common  to  Real  Options  (Mun  2002). 
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Option  (Real  Option)-  a  contract  that  gives  the  owner  the  right  but  not 
the  legal  obligation  to  buy  or  sell  an  underlying  asset  (invest  in  a 
project/asset). 

Call-  an  option  to  buy  (invest  in)  a  specified  number  of  shares  (specified 
project)  at  a  pre-established  price  within  some  future  perbd. 

Exercise  price  (Strike  price)-  the  price  stated  in  the  option  contract  at 
which  the  security  (project/asset)  can  be  bought  or  sold. 

Market  price-  the  value  of  the  underlying  security  (project)  in  the  market. 

Option  price  (Call  price)  -  the  market  price  for  the  option  contract. 

Expiration  date-  the  date  the  option  expires  or  matures. 

Options  effectively  restrict  downside  risk  due  to  uncertainty  while  retaining  the 
potential  for  upside  (good)  risk.  Figure  6  depicts  this  characteristic  of  options  (Devaraj 
and  Kohli  2002).  Here  we  see  that  the  option  is  exercised  only  when  the  market  price 
(M)  is  favorable  and  reaches  the  exercise  price  (X).  As  the  market  price  increases  the 
payoff  increases  as  illustrated  by  the  45-degree  line  following  the  exercise  price.  The 
graph  on  the  right  illustrates  that  the  profit  available  from  exercising  the  option  is  slightly 
reduced  by  the  amount  paid  for  the  option  referred  to  as  the  call  price  (-C).  As  previously 
discussed,  this  cost  also  represents  the  limit  on  loss  for  buying  the  option. 
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Figure  6.  Call  Option  Impact  on  the  Owner  from  (Devaraj  and  Kohli  2002). 
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2.  Real  Options 

Real  options  work  similar  to  the  financial  option  just  described.  However,  real 
options  apply  financial  option  theory  to  options  on  non- financial  (real)  assets.  The  same 
definitions  that  apply  to  financial  options  apply  to  real  options.  The  difference  is  that  the 
options  are  tangible  assets  or  projects  instead  of  financial  instruments  such  as  stocks  and 
securities.  In  the  case  of  real  options,  managers  identify  options  and  their  exercise  prices 
related  to  a  strategic  investment  or  project.  If  conditions  are  favorable  in  the  project,  the 
option  can  be  exercised.  However,  if  conditions  are  unfavorable,  the  option  need  not  be 
exercised  and  the  owner  loses  only  the  cost  of  the  option.  Figure  7  describes  the  various 
types  of  options  that  can  be  employed  using  ROM  (Devaraj  and  Kohli  2002).  The  arrows 
indicate  the  conditions  that  exist  with  up  arrows  meaning  favorable,  down  arrows 
signifying  unfavorable  conditions  and  bi-directional  arrows  indicating  the  preference  to 
wait/defer  until  some  future  event  (neither  favorable  or  unfavorable). 

•  Growth  Options:  If  first  one  is  successful,  produce  second  one 

•  Expansion  Options:  If  building  leases  all  space,  expand  facility 

•  Timing  (Wait)  Options:  Wait  to  see  what  the  market  does 

•  Change  Options:  If  Linux  catches  on,  our  PC  will  support 

•  Contract  (reduce)  Options:  Ability  to  decrease  scope 

•  Abandonment  Options:  If  the  market  is  soft. .  .stop  operations 

•  Compound  Options:  The  value  of  one  option  depends  on  another  option 
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Figure  7.  Types  of  Options  modified  from  (Devaraj  and  Kohli  2002). 

ROM  has  been  slowly  gaining  prominence  as  a  method  of  evaluating  capital 
investments  since  being  introduced  in  the  1980’s.  ROM  is  supported  by  the  Nobel  Prize- 
Winning  breakthrough,  the  Black- Scholes  model,  first  introduced  by  Fischer  Black, 
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Myron  Scholes  and  Robert  Merton  in  1973.  This  method  allows  managers  to  account  for 
and  manage  the  risk  and  uncertainty  of  capital  investment  decisions.  Pharmaceutical 
R&D,  petroleum  exploration,  and  energy  trading  companies  that  recognize  the  value  of 
quantifying  and  managing  investment  decision  risks  are  already  using  ROM. 

In  many  respects  IT  investment  decisions  are  very  similar  to  these  risk-oriented 
industry  segments.  The  bursting  of  the  technology  bubble  in  recent  years  has  driven 
home  this  point.  Attempts  have  been  made  to  address  investment  decision  risks  through 
probability  methods  that  incorporate  DCF,  decision  tree  analysis,  modeling  and 
simulation.  Unfortunately,  these  tools  still  fail  to  adequately  quantify  the  opportunities 
and  risks  associated  with  the  myriad  of  different  options  that  face  the  manager.  It  is 
important  to  note  that  ROM  should  not  be  viewed  as  disruptive  technology  that  will 
replace  the  fundamentals  of  DCF  and  NPV.  Instead,  ROM  should  be  used  as  a 
supplement  that  provides  yet  another  perspective  for  managers  attempting  to  identify  and 
weigh  competing  alternatives.  ROM  can  provide  valuable  insight,  allowing  managers  to 
see  opportunities  that  may  have  otherwise  gone  untapped.  Real  Options  provide  a 
valuable  tool  for  “identification,  valuation,  prioritization,  and  selection  of  strategic 
projects”  (Mun  2002).  Figure  8  provides  a  basic  example  describing  what  Real  Options 
are  (Copeland  and  Keenan  1998).  Figure  9  is  an  example  of  how  real  options  can  apply 
to  real-world  strategic  investment  decisions  (Mun  2002). 
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The  first  account  of  a  real  option  is  found  in  the  writings  of  Aristotle.  He  tells  of  how 
Thales  the  Melesian,  a  sophist  philosopher,  divined  from  some  tea  leaves  that  there 
would  be  a  bountiful  olive  harvest  in  six  months’  time.  Having  a  little  money,  he 
approached  the  owners  of  some  olive  presses  and  bought  the  right  to  rent  their  presses  at 
the  usual  rate.  When  a  record  harvest  duly  arrived  and  the  growers  were  clamoring  for 
pressing  capacity,  he  rented  the  presses  to  them  at  above  the  market  rate,  paid  the  normal 
rate  to  their  owners,  and  kept  the  difference  for  himself — proving  for  all  time  that 
sophism  is  not  only  an  honorable  profession,  but  a  profitable  one  too. 

What  is  the  real  option  in  this  story?  First  of  all,  Thales  purchased  the  right,  but  not  the 
obligation,  to  rent  the  presses.  (He  purchased  a  call  option,  the  right  to  buy  or  rent.  The 
opposite  is  a  put  option,  the  right  to  sell.)  Had  the  harvest  been  poor,  he  would  have 
chosen  not  to  rent,  and  lost  only  his  original  small  investment,  the  price  of  the  option. 

Thales  contracted  for  a  predetermined  rental  price  that  in  option  pricing  terminology  is 
called  the  exercise  price.  If  the  market  price  is  higher  than  the  exercise  price,  the  call 
option  is  said  to  be  “in  the  money,”  and  Thales  would  exercise  it.  If  the  market  price  is 
lower  than  the  exercise  price,  then  the  call  is  “out  of  the  money,”  and  would  not  be 
exercised. 

The  underlying  source  of  uncertainty  in  the  story  was  the  size  of  the  olive  harvest,  which 
affected  the  market  rental  value  of  the  presses.  As  the  value  of  the  underlying  variable 
increases,  so  does  the  value  of  the  option.  In  other  words,  the  greater  the  harvest  of 
olives  to  be  pressed,  the  more  valuable  Thales’  option  to  rent  the  presses  will  be. 

The  value  of  the  option  also  increases  with  the  level  of  uncertainty  of  the  underlying 
variable.  The  logic  is  straightforward.  If  there  is  no  uncertainty  over  the  size  of  the  olive 
harvest,  which  is  known  to  be  normal,  then  the  market  rental  value  of  the  presses  will 
also  be  normal  and  Thales’  option  will  be  worthless.  But  if  the  size  of  the  harvest  is 
uncertain,  there  is  a  chance  that  his  option  will  finish  in  the  money.  The  greater  the 
uncertainty,  the  higher  the  probability  that  the  option  will  finish  in  the  money,  and  the 
more  valuable  the  option. 

So  far  we  have  mentioned  three  of  the  five  variables  that  affect  the  value  of  the  option.  It 
increases  with  the  value  of  the  underlying  variable  and  with  its  uncertainty,  and  it 
decreases  as  the  exercise  price  goes  up.  The  fourth  variable  is  the  time  to  maturity  of  the 
option.  Thales  purchased  his  option  six  months  before  the  harvest,  but  it  would  have 
been  more  valuable  two  months  earlier,  because  uncertainty  increases  with  time. 

. .  .Finally,  the  value  of  the  option  increases  with  the  time  value  of  money,  the  risk-free 
rate  of  interest.  This  is  because  the  present  value  of  the  exercise  cost  falls  as  interest  rates 
rise. 

Figure  8.  Basic  Example  of  a  Real  Option  modified  from  (Copeland  and  Keenan  1998). 
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E-Business  Initiative  Example: 

Managers  of  an  investment  bank  are  currently  contemplating  the  development  of  an  e- 
business  initiative  in  response  to  the  e-business  boom  experienced  in  recent  years.  These 
managers  recognize  that  their  options  range  from  developing  a  static  Web  site  with  a  map 
of  its  location  and  text  explaining  what  their  business  did  to  a  more  elaborate  interactive 
site  providing  bill-paying,  stock  trades  and  loan  applications.  They  realize  that 
competition  from  other  online  stock  trading  and  lending  service  firms  would  be  an  issue 
but  were  concerned  about  being  left  behind  as  more  institutions  move  to  e-business. 
Unfortunately,  the  impact  of  competition,  customer  acceptance  of  their  e-business 
initiative  and  regulatory  changes  are  all  areas  of  high  uncertainty.  At  this  point  some 
major  questions  have  to  be  answered: 

What  if  the  strategy  flops? 

Are  there  future  growth  opportunities? 

Should  we  outsource  the  e-business  initiative  or  build  it  from  the  ground  up? 

How  do  you  prioritize  potential  strategies  and  perform  a  Bnancial  and  strategic 
feasibility  analysis? 

What  is  the  impact  on  the  organization  for  going  down  the  wrong  path? 

If  we  realize  we  are  on  the  wrong  path  after  starting,  can  we  take  steps  to  get  on  the 
right  path? 

What  options  can  we  create  to  enable  this? 

Which  of  these  strategies  is  optimal? 


Figure  9.  Real  Options  Scenario  modified  from  (Mun  2002). 

The  Real  Options  Method  can  provide  answers  to  these  important  questions  and 
facilitate  better  decisions  by  helping  managers  to  effectively  identify  and  evaluate 
alternatives.  Specifically,  ROM  is  useful  in: 

•  Identifying  different  strategic  investment  decision  pathways. 

•  Valuing  each  strategic  decision  pathway  and  its  financial  viability  and  feasibility. 

•  Prioritizing  these  pathways/projects  based  on  qualitative  and  quantitative  metrics. 

•  Optimizing  the  value  of  strategic  investment  decisions  by  evaluating  different 
decision  paths. 
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•  Timing  the  effective  execution  of  investments  and  finding  the  optimal  trigger  values 
and  cost  of  revenue  drivers. 

•  Managing  existing  or  developing  new  optionalities  and  strategic  decision  pathways 
for  future  opportunities  (Mun  2002). 

B.  ADDRESSING  RISK  WITH  ROM 

Managers  recognize  that  strategic  investments  are  often  made  in  uncertain 
environments,  which  leads  to  financial  risk.  Strategic  investments  in  government, 
including  information  technology  investments,  fall  into  this  category.  ROM  is  a  tool  that 
allows  managers  to  use  options  techniques  to  minimize  these  financial  risks.  We  begin 
our  discussion  by  defining  risk. 

1.  Risk 

A  typical  dictionary  defines  risk  as  the  possibility  of  suffering  harm  or  loss.  A 
more  academic  description  of  the  term  identifies  risk  as  a  combination  of  the  probability 
of  an  event  occurring  and  the  severity  or  magnitude  of  that  event  (Liao  2002).  Figure  10 
illustrates  this  balancing  of  probability  and  magnitude  in  relation  to  IT  investment  risk 
(Jeffery  2003). 
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Figure  10.  Risk  Matrix  from  (Jeffery  2003). 

When  relating  this  idea  to  IT  investments,  risk  can  be  thought  of  as  the  possibility 
that  if  something  goes  wrong  with  the  project,  the  organization  may  not  be  able  to  realize 
the  projected  value  that  justified  the  project  in  the  first  place.  This  simple  realization 
drives  prudent  managers  to  dedicate  significant  resources  to  identifying,  measuring  and 
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mitigating  risks.  In  fact,  the  legislation  that  has  led  to  the  adoption  of  ITPM,  the  Clinger- 
Cohen  Act,  lists  risk  management  as  a  primary  objective.  Implementations  of  ITPM  have 
provided  managers  with  tools  for  measuring  the  risks  that  exist  in  projects  and  have  made 
it  possible  to  systematically  avoid  some  risks.  Key  risk  areas  incorporated  into  the  DON 
IT  Capital  Planning  Guide  framework  include: 

Minimal  ROI  (or  NPV):  An  investment  with  a  minimally  acceptable  ROI 
(or  NPV)  is  inherently  risky.  Unexpected  cost  growth  could  cause  the 
ROI  (or  NPV)  to  shift  into  the  unfavorable  range. 

Project  Longevity:  Longer  duration  projects  are  more  risky  than  those 
that  adopt  a  modular  approach  that  combines  controlled  system 
development  with  rapid  prototyping. 

Technical  Risk:  Investments  which  involve  “cutting  edge”  technology  or 
which  represent  new  developmental  items  are  more  risky  than  those  that 
take  advantage  of  commercially  available  or  non- developmental  items 
(DON  2001a). 

These  observations  are  indicative  of  the  way  risk  is  addressed  in  ITPM  literature 
throughout  government.  This  also  reflects  the  reliance  of  ITPM  on  traditional  methods  of 
analyzing  competing  alternatives  for  IT  investment.  Unfortunately,  this  type  of  risk 
aversion  can  potentially  lead  to  mana^rs  passing  up  on  significant  opportunities. 
Intuitively,  managers  recognize  that  some  risks  must  be  assumed  to  take  advantage  of  the 
opportunities  that  technology  can  potentially  create.  The  DON  faces  this  same  dilemma 
as  it  embarks  on  progressive  initiatives  like  Sea  Power  21  with  Littoral  Combat  Vehicles 
and  with  NMCI,  the  military’s  largest  information  technology  program.  Change  happens, 
and  managers  understand  the  need  to  take  on  certain  risks  to  achieve  and  retain 
competitive  advantage.  The  current  methods  employed  by  ITPM  are  limited  in  their 
ability  to  help  managers  deal  with  managing  risk.  ROM  offers  an  alternative  view. 
Instead  of  viewing  risk  and  uncertainty  as  something  to  be  avoided  at  all  costs,  ROM 
demonstrates  that  uncertainty  can  be  leveraged  to  allow  organizations  to  exploit 
opportunities  that  could  be  overlooked  when  using  only  traditional  tools  to  assess 
investments. 
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2.  ROM  and  Risk 

ROM  turns  the  traditional  view  of  risk  and  uncertainty  upside  down.  ROM  can 

be  used  in  situations  where  management  has  flexibility  in  making  large  capital 

investment  decisions.  The  NAVSUP  Portfolio  Management  framework  expands  upon 

the  DON  Capital  Planning  Guide  by  identifying  four  categories  or  risk: 

Cost  sensitivity-  The  sensitivity  or  quality  of  price  estimates. 

Technical  Risk-  Risk  to  completing  the  system  from  a  technical 
standpoint  (i.e.  hardware/software  conformity,  availability  of  commercial 
support). 

Organizational  Risk-  Risk  that  the  proposed  system  will  fail  due  to 
organizational  disruptbn  (i.e.  degree  of  organizational  change  required  by 
the  system). 

Risk  of  Not  Doing-  Risk  to  the  organization  for  not  proceeding  with  the 
project. 

We  have  discussed  how  risk  is  categorized  in  the  DON  and  NAVSUP  literature. 
The  extensive  discussion  of  risk  in  portfolio  management  and  capital  investment 
literature  underscores  the  importance  being  placed  on  managing  risk.  However,  all  of 
these  categories  of  risk  can  be  further  simplified  into  two  major  types  of  risk---unique 
(private)  risk  and  systematic  (market)  risk  (Boer  2002a).  Unique  risks  can  be  thought  of 
as  those  risks  that  are  inherent  to  a  particular  organization  and  are  partially  subject  to  the 
organization’s  control.  These  are  the  types  of  risks  that  have  been  a  focus  of  the  current 
implementatbns  of  ITPM.  As  one  might  suspect,  the  higher  the  unique  risk  the  lower  the 
value  of  a  project.  Conversely,  systematic  risks  are  based  on  volatility  that  organizations 
cannot  control.  This  category  of  risks  is  where  ROM  offers  significant  potential.  ROM 
leverages  the  uncertainty  that  permeates  systematic  risks  to  identify  opportunities  and 
create  value.  Most  projects  have  aspects  of  both  of  these  types  of  risks.  Current 
implementations  of  ITPM  neglect  this  fact  and  therefore  cause  managers  to  overlook 
opportunities  that  appear  unattractive  due  to  limitations  present  in  current  tools  such  as 
NPV  and  decision  tree  analysis. 

Identifying  and  addressing  risks  is  an  important  aspect  of  managing  any 
organizational  activity.  Financial  risks  associated  with  IT  investment  decisions  can  be 
vital  to  the  future  of  an  organization.  Hershey’s  flawed  implementation  of  an  Enterprise 
Resource  Planning  system  is  a  good  example  of  this.  In  Hershey’s  case,  the  company 

lost  millions  of  dollars  in  sales  (18.6%  decrease  in  quarterly  sales)  during  the  Halloween 
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and  Christmas  season  due  to  problems  getting  products  to  store  shelves  (Osterland  2000). 
This  devastating  financial  impact  is  evidence  of  the  importance  of  managing  risks 
associated  with  new  investments  and  projects. 

Risk  management  frameworks  such  as  the  ones  advocated  by  the  Software 
Engineering  Institute  and  the  Project  Management  Institute  are  gaining  acceptance. 
These  approaches  range  from  “qualitative  and  subjective  assessments  of  risk  to  highly 
evolved  mathematical  models  to  determine  optimal  courses  of  action  based  on  time- 
dependent  probabilities”  (Dushanko  2003).  ROM  incorporates  quantitative  measures 
such  as  the  volatility  measure  derived  through  Monte  Carlo  simulation  with  the  strategic 
assessments  and  justifications  found  in  typical  business  case  analyses.  As  a  result, 
decision-makers  have  additional  information  that  can  be  crucial  in  making  decisions 
when  a  high  degree  of  uncertainty  exists  for  key  elements  of  the  business  case  such  as 
cash  flows,  costs,  and  effectiveness. 

C  APPLYING  ROM  IN  IT  PORTFOLIO  MANAGEMENT 

ITPM  is  a  system  for  evaluating,  selecting,  prioritizing,  budgeting  and  planning 
for  investments.  The  selection  and  evaluation  of  investments  is  done  utilizing  traditional 
discounted  cash  flow  methods  that  often  do  not  account  for  the  uncertainty  that  managers 
face  when  making  strategic  investments.  ROM  offers  promise  as  an  additional  tool  at  the 
disposal  of  managers  to  deal  with  uncertainty  and  reduce  exposure  to  financial  risks.  We 
begin  our  discussion  by  comparing  ROM  to  the  traditional  discounted  cash  flow 
methodology  currently  used  in  ITPM. 

1.  Comparing  ROM  to  Traditional  Methods 

ROM  takes  into  account  the  fact  that  an  organization’s  environment  is  fraught 
with  uncertainty  and  risk.  An  important  characteristic  of  uncertainty  is  that  it  typically 
becomes  reduced  over  time,  as  more  information  is  known.  ROM  incorporates  this 
learning  characteristic,  while  traditional  methods  assume  away  the  flexibility  managers 
have  to  delay  or  modify  decisions  as  more  information  becomes  available.  Therefore, 
increases  in  time  horizon  and  uncertainty  actually  increase  the  value  of  a  real  option. 
Figure  11  illustrates  this  principle  (Amran  and  Kulatilaka  1999).  The  diagram  on  the  left 
illustrates  the  traditional  view  that  shows  value  decreasing  as  uncertainty  increases  and 

the  real  options  view,  which  shows  value  increasing  as  uncertainty  increases  due  to 
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options.  The  bold  line  on  the  right  side  of  the  diagram  illustrates  the  benefits  of  options 
in  minimizing  losses  while  maintaining  the  potential  for  gains.  The  dashed  line  in  this 
diagram  shows  the  increased  exposure  to  potential  losses  when  options  are  not 
incorporated.  Here  we  see  just  how  useful  options  can  be  in  reducing  financial  risk. 


Traditional  View  (No  options)  “  “  “  '  w/o  options  ■■■■■■■■ 

RealOptionsVlew  -  withoptions  - 

Figure  11.  ROM  vs.  Traditional  Analysis  modified  from  (Amran  and  Kulatilaka  1999). 

The  ROM-ITPM  methodology  advocated  by  this  study  attempts  to  identify 
situations  when  uncertainty  of  cash  flows  (or  savings)  exists  and  there  is  flexibility 
regarding  the  investment  decision  (alternative  options).  Figure  12a  is  a  logical  diagram 
that  illustrates  how  investment  decisions  are  made  using  only  traditional  discounted  cash 
flow  models.  Once  again,  this  logical  process  fails  to  capture  the  dynamic  nature  of 
investment  decisions.  Figure  12b  is  a  logical  diagram  of  how  the  proposed  ROM-ITPM 
may  be  incorporated  to  provide  additional  insights  into  investment  decisions. 
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a.  Logical  Diagram  of  the  Current  Investment  Decision  Process. 


Develop  Business 
Case  For 

Proposed  Projects 


Use  ROM-ITPM 
Framework 


Exercise  Option 
(Expand/Invest) 


b.  Diagram  Incorporating  the  Proposed  ROM-ITPM  Methodology. 
Figure  12.  ROM-ITPM  Methodology. 


This  modified  logical  diagram  provides  a  disciplined  approach  to  making 
investment  decisions  needed  to  provide  additional  insights  necessary  for  better 
investment  decisions.  The  remainder  of  this  chapter  is  dedicated  to  defining  the  three- 
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step  process  of  the  ROM-ITPM  methodology  and  the  important  information  this  new 
methodology  can  provide. 

2.  Steps  for  Using  ROM  to  Evaluate  a  Project 

Using  ROM  to  evaluate  a  project  can  be  accomplished  through  a  series  of  steps, 
which  include  framing  the  option,  analyzing  the  option  and  acting  or  exercising  the 
option.  Intuitively,  most  DON  managers  evaluate  options  every  day.  They  begin  with  a 
subjective  assessment  of  the  probability  of  a  risk  event  associated  with  a  decision  and 
attempt  to  ascertain  whether  the  potential  benefits  outweigh  the  potential  costs. 
Managers  do  this  because  they  understand  that  they  can  little  afford  to  ignore  the  fact  that 
the  value  of  a  long-term  project  may  change  over  time  due  to  rapidly  changing 
technology,  shifting  requirements  and  changing  threats.  ROM  provides  a  mechanism  to 
quantify  this  sort  of  management  intuition.  As  resources  become  increasingly 
constrained,  it  will  become  even  more  important  for  managers  to  be  able  to  effectively 
quantify  the  value  of  alternatives  to  facilitate  intelligent  comparisons  and  sound 
investment  decisions. 

ROM  is  not  a  one  size  fits  all  solution.  In  fact,  there  are  times  when  ROM  is  not 
recommended.  For  instance,  projects  with  cash  flows,  costs  and  effectiveness  that  are 
known  or  predictable  with  a  high  degree  of  certainty  do  not  require  the  added  rigor  of 
ROM.  Also,  in  cases  where  mandates  exist  for  how,  when  and  what  to  invest  in,  ROM  is 
of  little  use.  In  such  cases,  where  little  uncertainty  exists  or  when  no  options  exist  the 
traditional  methods  for  making  investments  are  suitable.  ROM  should  be  used  when  any 
of  the  following  situations  exist: 

•  There  is  a  contingent  investment  decision. 

•  Uncertainty  is  large  enough  to  make  it  worthwhile  to  wait  for  more  information. 

•  Value  may  be  captured  in  possibilities  for  future  growth  options 

•  Uncertainty  is  large  enough  to  make  flexibility  a  consideration. 

•  When  there  will  be  project  updates  and  mid-course  strategy  corrections  (Amran  and 
Kulatilaka  1999). 
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a.  Framing  the  Option 

Framing  can  be  thought  of  in  terms  of  identifying  and  defining  an 
opportunity.  It  is  accomplished  by  dividing  the  path  to  the  objective  into  separate  stages. 
For  instance,  a  large  project  with  a  large  amount  of  uncertainty  can  be  separated  into  a 
series  of  smaller  pilot  projects.  This  allows  the  organization  to  test  the  risks  of  the 
project  at  a  reduced  cost  before  expanding  the  project.  Figure  13  is  an  example  of  the 
type  of  strategic  tree  that  may  be  used  to  frame  options. 


Do  nothing 

Figure  13.  Strategic  Tree  Example. 

Framing  the  option  also  involves  developing  a  business  case  and  assessing 
the  risks  involved.  Developing  the  business  case  and  assessing  risks  are  already  integral 
parts  of  ITPM.  Although  this  process  typically  occurs  in  the  initial  stages  of  ITPM  it  is 
also  a  critical  part  of  the  ROM- ITPM  methodology  that  deserves  mention.  The  business 
case  must  establish  the  costs  and  value- creating  elements  of  the  proposed  project  in  the 
form  of  cost- savings/cost  avoidances,  or  improved  capabilities.  When  establishing  the 
business  case  the  organization  evaluates  whether  the  proposed  investment  fits  its  current 
strategy.  In  an  article  on  this  subject,  Anthony  Tjan  provides  a  strong  argument  that 
management  should  focus  on  identifying  the  viability  and  business  fit  of  proposed 
technology  initiatives  (Tjan  2001). 

Tjan  observed  that  companies  often  hurt  themselves  by  simultaneously 
embarking  on  numerous  uncoordinated  projects,  betting  their  company’s  future  on  one 
major  project,  or  simply  following  the  crowd  investing  in  “the  next  big  thing”. 
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Unfortunately,  DOD  has  also  been  guilty  of  such  faulty  practices  when  making 
investment  decisions.  At  any  given  time  there  are  multiple  initiatives  underway  designed 
to  perform  similar  tasks.  For  example,  the  CFO  Act  was  enacted  specifically  to  address 
the  costly  duplication  of  operating  over  751  financial  management  systems  within 
government  (McCaffery  and  Jones  2001).  It  has  become  increasingly  important  that 
leaders  remain  focused  on  ensuring  fit  when  embarking  on  new  investments  to  ensure 
better  investment  decisions.  Tjan  has  introduced  portfolio  maps  as  a  method  to  aid 
managers  in  making  Internet  initiative  investment  decisions.  This  study  incorporates  the 
use  of  portfolio  maps  as  a  simpfe  heuristic  tool  that  can  aid  DON  leaders  in  evaluating 
business  cases  within  the  proposed  ROM-ITPM  framework 

Managers  must  ensure  that  IT  investments  are  evaluated  for  business 
viability  and  business  fit.  The  viability  of  a  project  is  based  on  quantitative  data  about  an 
investment’s  likely  payoff.  Conversely,  fit  is  a  qualitative  assessment  that  attempts  to 
measure  how  well  an  investment  matches  the  organization’s  existing  processes, 
capabilities  and  culture.  (Tjan,  2001) 

Assessing  business  viability  is  important  to  ensure  that  funding  and 
personnel  requirements  are  reasonable  in  light  of  existing  budgets  and  manpower 
resources.  In  addition,  market  value  potential  is  important  when  assessing  whether  or  not 
the  investment  will  produce  a  significant  savings/cost  reduction  or  vital  capability  for 
DOD.  However,  focusing  solely  on  the  viability  of  a  project  can  result  in  the  adoption  of 
projects  that  have  merit  but  are  incongruent  with  the  organization’s  core  competencies. 

Therefore,  managers  must  be  concerned  with  how  well  projects  fit  core 
capabilities,  existing  initiatives,  organizational  structure,  organization  culture  and 
ease/feasibility  of  technical  implementation.  For  instance,  the  emergence  of  e-commerce 
and  the  use  of  the  Internet  for  organization  transactions  has  become  a  common 
occurrence.  However,  many  organizations,  including  DOD,  have  been  forced  to  consider 
whether  to  pursue  such  initiatives  and  to  what  extent  these  initiatives  should  be  pursued 
in-house. 

The  portfolio  map  illustrated  in  Figure  14  provides  a  tool  for  evaluating 
investment  strategies  based  on  the  degree  of  viability  and  fit  of  a  project  (Tjan  2001). 
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For  instance,  in  the  e-commerce  example  described  above,  managers  may  make  the 
assessment  that  although  a  project  is  sound  and  will  produce  tangible  benefits  it  is  not  a 
core  capability  of  the  organization.  In  such  cases,  the  project  can  be  described  as  having 
a  high  degree  of  viability  but  a  low  degree  of  fit.  The  portfolio  map  illustrates  that  such 
a  project  should  be  re-assigned  or  outsourced.  By  outsourcing  this  project  the 
organization  can  use  its  resources  (personnel  and  time)  to  concentrate  on  core  areas. 
These  types  of  decisions  have  become  increasingly  important  in  DOD  as  the  demands  on 
our  limited  military  forces  have  continued  to  expand. 

Portfolio  Map 

high 


g 

i:s 

low  high 

Fit 

I - 1  Most  immediate  and  relevant  opportunities 

Figure  14.  ROM-ITPM  Portfolio  Map  from  (Tjan  2001). 

The  proposed  ROM-ITPM  methodology  advocated  by  this  study 
incorporates  an  assessment  of  strategic  fit  and  viability.  The  attention  given  to  these  two 
important  aspects  of  a  proposed  investment  ensures  that  proposals  not  worthy  of 
management  attention  are  weeded  out  early. 

Another  critical  aspect  of  framing  options  is  the  process  of  conducting  a 
risk  assessment.  In  this  proposed  ROM-ITPM  methodology,  the  risk  assessment  will  be 
based  on  the  NAVSUP  criteria  discussed  in  Chapter  II  of  this  study: 


Re-assign 
or  Outsource 

Invest 

Kill 

Revamp 

Cost  sensitivity-  The  sensitivity  or  quality  of  price  estimates. 
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Technical  Risk-  Risk  to  completing  the  system  from  a  technical 
standpoint  (i.e.  hardware/software  conformity,  availability  of  commercial 
support). 

Organizational  Risk-  Risk  that  the  proposed  system  will  fail  due  to 
organizational  disruption  (i.e.  degree  of  organizational  change  required  by 
the  system). 

Risk  of  Not  Doing-  Risk  to  the  organization  for  not  proceeding  with  the 
project. 

The  ROM-ITPM  model  developed  in  this  study  will  incorporate  business 
case  and  risk  assessment  methods  used  in  the  NAVSUP  Corporate  Project  Management 
System  (CPMS)  discussed  in  Chapter  II  of  this  study. 

b.  Analyzing  the  Option 

Analyzing  options  involves  the  application  of  options  algorithms.  Options 
algorithms  can  be  accomplished  using  Monte  Carlo  path-dependent  simulation  methods, 
binomial  lattices  and  closed- form  equations  such  as  the  risk- neutral  Black-Scholes 
model.  Binomial  lattices  and  derivations  of  the  Black-Scholes  formula  are  the  most 
commonly  used  of  these  techniques.  This  study  incorporates  the  mathematical  discipline 
of  the  Black-Scholes  formula  and  the  flexibility  of  binomial  lattices  available  in  Crystal 
Reports®  Real  Options  software  for  valuing  options.  This  combined  approach  provides 
us  with  the  accuracy  of  the  Black-Scholes  formula  and  the  flexibility  of  binomial  lattices 
in  modeling  and  simulating  outcomes. 

The  Black-Scholes  formula  consists  of  five  parameters: 

(1)  Value  of  the  underlying  security/project  (V)  -  Expected  cost 
savings/cost  avoidance  or  increase  in  capabilities  obtained  by  using 
traditional  DCF  methods. 

(2)  Exercise  (strike)  price  (X)  -  Stated  price  at  which  the  security 
(project)  can  be  bought  or  sold. 

(3)  Time  to  expiration  (T)  -  Length  of  time  from  one  stage  of  the 
program  to  the  next  opportunity  to  exercise  the  option. 

(4)  Volatility  (a)  -  Degree  of  uncertainty  that  exists  regarding  the 
program. 

(5)  Risk-free  interest  rate  (r)-  Standard  rate  used  based  on  the 
government  Treasury  bond  (Mun  2002). 
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The  Black- Scholes  formula  and  its  underlying  assumptions  are  listed  in 
Figure  15  (Mun  2002).  This  formula  is  used  to  calculate  the  value  of  a  Real  Options  call 
(C). 


d  =  _ ^ ^ _ 

o4f 

dj  =  d.  -a 


C=  Value  of  a  call  option 
N=  Cumulative  standard  normal  distribution 
e=  exponential  term  (2.7183) 
d=  continuous  dividend  payout 


Assumptions  of  the  Black  and  Scholes  Model: 

1)  The  stock  pays  no  dividends  during  the  option's  life-  Most 
companies  pay  dividends  to  their  share  holders,  so  this  might  seem  a 
serious  limitation  to  the  model  considering  the  observation  that  higher 
dividend  yields  elicit  lower  call  premiums.  A  common  way  of  adjusting 
the  model  for  this  situation  is  to  subtract  the  discounted  value  of  a  future 
dividend  from  the  stock  price. 

2)  European  exercise  terms  are  used-  European  exercise  terms  dictate 
that  the  option  can  only  be  exercised  on  the  expiration  date.  American 
exercise  term  allow  the  option  to  be  exercised  at  any  time  during  the  life 
of  the  option,  making  american  options  more  valuable  due  to  their  greater 
flexibility.  This  limitation  is  not  a  major  concern  because  very  few  calls 
are  ever  exercised  before  the  last  few  days  of  their  life.  This  is  true 
because  when  you  exercise  a  call  early,  you  forfeit  the  remaining  time 
value  on  the  call  and  collect  the  intrinsic  value.  Towards  the  end  of  the  life 
of  a  call,  the  remaining  time  value  is  very  small,  but  the  intrinsic  value  is 
the  same. 

3)  Markets  are  efficient-  This  assumption  suggests  that  people  cannot 
consistently  predict  the  direction  of  the  market  or  an  individual  stock.  The 
market  operates  continuously  with  share  prices  following  a  continuous  Ito 
process.  To  understand  what  a  continuous  Ito  process  is,  you  must  first 
know  that  a  Markov  process  is  "one  where  the  observation  in  time  period  t 
depends  only  on  the  preceding  observation."  An  Ito  process  is  simply  a 
Markov  process  in  continuous  time.  If  you  were  to  draw  a  continuous 
process  you  would  do  so  without  picking  the  pen  up  from  the  piece  of 
paper. 

4)  No  commissions  are  charged-  Usually  market  participants  do  have  to 
pay  a  commission  to  buy  or  sell  options.  Even  floor  traders  pay  some  kind 
of  fee,  but  it  is  usually  very  small.  The  fees  that  Individual  investor's  pay 
is  more  substantial  and  can  often  distort  the  output  of  the  model. 

5)  Interest  rates  remain  constant  and  known-  The  Black  and  Scholes 
model  uses  the  risk-free  rate  to  represent  this  constant  and  known  rate.  In 
reality  there  is  no  such  thing  as  the  risk-free  rate,  but  the  discount  rate  on 
U.S.  Government  Treasury  Bills  with  30  days  left  until  maturity  is  usually 
used  to  represent  it.  During  periods  of  rapidly  changing  interest  rates, 
these  30  day  rates  are  often  subject  to  change,  thereby  violating  one  of  the 
assumptions  of  the  model. 

6)  Returns  are  lognormally  distributed-This  assumption  suggests, 
returns  on  the  underlying  stock  are  normally  distributed,  which  is 
reasonable  for  most  assets  that  offer  options. 


Figure  15.  Black-Scholes  Formula  and  Assumptions  from  (Mun  2002). 
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The  primary  benefit  of  the  Black-Scholes  formula  is  that  very  little 
information  is  needed  about  the  underlying  asset  in  order  to  compute  the  value  of  the 
option.  An  in-depth  discussion  of  the  Black-Scholes  would  require  significant  coverage 
of  advanced  mathematics  and  is  beyond  the  scope  of  this  study.  Actual  calculations  will 
be  achieved  utilizing  software  designed  to  generate  solutions  based  on  the  five 
parameters  described  above.  Before  applying  option  algorithms  a  nunager  knows  the 
cost  of  the  project  (X),  the  anticipated  time  before  being  able  to  execute  the  project 
option  (T),  the  value  of  the  underlying  asset/project  based  on  simulated  discounted  cash 
flows  (V),  and  the  risk-free  interest  rate  (r).  The  remaining  volatility  parameter  (cj)  is 
computed  using  techniques  described  later  in  this  chapter. 

Although  an  in-depth  discussion  of  the  Black-Scholes  formula  is  beyond 
the  scope  of  this  study,  understanding  the  important  relationships  expressed  by  this 
equation  is  helpful  in  understanding  ROM.  Simply  put,  the  fair  market  value  of  a  call 
option  is  determined  by  taking  the  difference  between  the  expected  value  of  the 
project/asset  and  the  present  value  of  what  is  paid  to  invest  in  that  project/asset.  The 
expected  value  of  the  underlying  asset/project  is  (VN  di)  and  the  present  value  of  paying 
the  exercise  price  for  that  asset/project  (Xe  '^'N  d2).  The  continuous  dividend  payouts  (di 
and  d2)  are  computed  percentages  designed  to  reflect  the  impact  of  time  and  uncertainty 
on  V  and  X.  Figure  16  is  a  deconstruction  of  the  Black-Scholes  equation  that  illustrates 
this  point  (Amran  and  Kulatilaka  1999).  We  see  from  the  Black-Scholes  equation  that 
higher  uncertainty  and  longer  times  to  expiration  result  in  a  higher  option  value.  This 
option  value  is  useful  to  management  because  it  places  a  price  tag  on  how  much 
managers  should  be  willing  to  pay  for  an  option.  When  considering  real  options,  this  is 
the  amount  of  funding  allotted  for  a  pilot  project,  or  how  much  should  be  spent  on 
assets/projects  that  provide  opportunities  for  future  expansion  or  greater  capabilities. 
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Figure  16.  Black-Scholes  Deconstructed  modified  from  (Amran  and  Kulatilaka  1999). 

Although  not  as  precise,  binomial  lattices  lead  ta  results  similar  to  those 
derived  using  Black-Scholes.  Binomial  lattices  provide  a  discrete  simulation  of 
stochastic  processes  (involving  probabilities).  They  are  useful  because  they  provide  a 
simple  graphical  method  of  understanding  the  range  of  alternatives  available  based  on  the 
probabilities  of  various  outcomes.  The  accuracy  of  binomial  lattices  are  based  on  the 
number  of  branching  events  in  a  lattice  referred  to  as  time- steps.  These  time  steps  should 
not  be  confused  with  the  branches  of  the  strategic  tree  discussed  in  step  one  of  this  three- 
step  process.  Instead,  these  time- steps  represent  the  number  of  simulations  of  the 
stochastic  processes  related  to  a  single  strategic  pathway  within  a  given  time  frame.  As 
the  number  of  time- steps  used  in  formulating  binomial  lattices  increase,  the  calculated 
solution  approaches  the  closed-form  Black-Scholes  solution.  Similar  to  Black-Scholes, 
binomial  lattices  are  derived  through  risk  neutral  valuation  using  risk-free  rates  of  return. 
The  starting  value  of  the  underlying  asset  (V)  is  multiplied  by  the  up  (u)  and  down  (d) 
factors  to  create  the  binomial  lattice.  These  factors  provide  a  method  of  determining  the 
change  in  project  value  based  on  different  outcomes  with  up  meaning  favorable  and 
down  indicating  unfavorable  outcomes.  Figure  17  below  illustrates  how  these  binomial 
lattices  are  derived  (Mun  2002). 


40 


Value  of  underlying 
asset  from  DCF  and 
MC  simulations 


Best 

Case 


VnU3 


VnUd 


Vnd^ 


Binomial  Lattice  of  Underlying 
Asset  Value 


Worst 

Case 


Time  - 
Steps 


u  =  and 
d  =  =Hu 


P  = 


e 


(r-b)dt 


-  d 


u-d 


V=  PV  of  implementation 
X=  Option 
s  =  Volatility 
T=  Time  to  expiration 
r=  Risk-free  rate 
u=  Up  factor 
d=  Down  factor 
b=  Dividend  outflows  % 
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Figure  17.  Binomial  Lattices  modified  from  (Mun  2002). 

The  up  and  down  factors  in  the  binomial  lattice  allow  the  replication  of 
favorable  (up)  and  unfavorable  (down)  outcomes  over  a  series  of  time  steps.  Again,  the 
number  of  time  steps  may  be  increased  to  increase  the  accuracy  of  the  computation.  A 
minimum  of  1,000  time  steps  is  necessary  to  achieve  sufficient  accuracy  but  exact 
convergence  to  the  Black-Scholes  solution  typically  occurs  at  50,000  steps  (Mun  2002). 
Figure  16  also  illustrates  the  range  of  solutions  offered  by  the  binomial  lattice  that  gives 
managers  a  best  case  (Vqu^)  and  worst  case  (Vod^).  Similar  to  the  Black-Scholes 
equation,  the  calculations  involved  in  the  construction  of  binomial  lattices  are  significant. 
Detailed  coverage  of  these  calculations  are  beyond  the  scope  of  this  study,  interested 
readers  may  find  greater  coverage  of  binomial  lattices  in  Johnathan  Mun’s  Real  Options 
Analysis  (Mun  2002). 
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This  study  will  utilize  binomial  lattices  as  well  as  the  Black-Scholes 
model  for  the  purpose  of  discussion  because  “it  is  recommended  that  both  approaches  be 
used  to  verify  the  results”  of  calculations  (Mun  2002).  The  Crystal  Reports®  Real 
Options  software  incorporates  both  Black-Scholes  and  binomial  lattices  into  a  single 
graphical  display  based  on  common  inputs:  (1)  value  of  the  underlying  asset  -  V,  (2) 
exercise  price-X,  (3)  time  to  expiration- T,  (4)  risk-free  rate-  r,  and  (5)  volatility-  o  .  For 
this  reason,  the  results  of  the  Serial  Number  Tracking  example  provided  in  Chapter  Four 
will  be  illustrated  using  binomial  lattices  produced  in  the  Crystal  Reports®  Real  Options 
software. 

The  first  stage  in  applying  these  options  algorithms  is  to  use  the  strategic 
tree  structure  developed  in  the  framing  step  to  identify  the  scenarios  that  can  be 
undertaken.  Based  on  this  strategic  tree,  calculate  the  net  present  value  (NPV)  of  each 
potential  strategy  using  discounted  cash  flow  methodology.  Incorporating  Monte  Carlo 
simulations  to  improve  upon  this  calculation  can  be  useful.  Keep  in  mind  that  utilizing 
Crystal  Ball®  to  simulate  cash  flows  and  improve  the  NPV  calculation  is  not  a  substitute 
for  ROM.  Such  simulations  do  not  provide  important  information  such  as  the  cost  of 
waiting,  the  value  of  an  option,  and  the  optimal  time  to  expand. 

The  NPV  obtained  at  this  point  is  the  value  of  the  underlying  asset  (V) 
required  for  calculating  the  value  of  the  option.  The  next  and  most  challenging  stage  in 
applying  these  algorithms  is  to  calculate  the  volatility,  a  numerical  expression  of  the 
uncertainty  of  the  predicted  benefits/savings/cash  flows.  Accounting  for  this  uncertainty 
is  one  of  the  major  differences  between  ROM  and  traditional  discounted  cash  flow 
methods.  The  uncertainty  surrounding  cash  flows  is  referred  to  as  volatility  (s). 
Volatility  is  “...the  most  difficult  input  parameter  to  estimate  in  a  real  options  analysis” 
(Mun  2002). 

The  ROM  volatility  estimate  may  be  derived  using  several  different 
approaches.  These  include  the  logarithmic  cash  flow  returns  approach,  logarithmic 
present  value  approach,  management  assumption  approach,  market  proxy  approach  and 
the  complex  Generalized  Autoregressive  Conditional  Heteroskedasticity  (GARCH) 
approach  which  is  based  on  the  work  of  the  recent  Nobel  Prize  winner  NYU’s  Robert  F. 
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Engle  (Mun  2002). 3  For  the  purposes  of  this  study  we  will  utilize  the  logarithmic  present 
value  approach  because  it  accommodates  the  initial  negative  cash  flows  experienced  in 
our  SNT  example.  This  approach  assumes  a  10  percent  discount  rate  and  collapses  all 
future  cash  flow  estimates  into  two  sets  of  present  values,  one  for  the  first  time  period 
(time  period  one)  and  another  for  the  present  time  (time  period  zero).  The  log  of  the 
present  value  at  time  period  one  is  then  divided  by  the  log  of  time  period  zero  to  obtain 
an  X- value  (ratio  of  the  two  present  values).  A  Monte  Carlo  simulation  is  then  used  to 
calculate  a  standard  deviation  for  a  forecasted  distribution  of  the  X- value.  This  standard 
deviation  is  used  as  the  volatility  estimate  ^)  for  Black- Scholes  and  binomial  lattice 
calculations.  This  computation  along  with  the  other  volatility  estimate  approaches 
mentioned  above  can  be  accomplished  quickly  utilizing  the  volatility  estimates  tool  found 
in  Crystal  Ball®  Real  Options  Software  used  in  this  study.  Figure  18  illustrates  the 
results  obtained  from  this  computation. 
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3  Discussion  of  GARCH  and  other  advanced  methods  of  calculating  volatility  are  beyond  the  scope  of 
this  research.  More  information  regarding  the  use  of  these  techniques  can  be  found  in  Johnathan  Mun’s 
Real  Options  Analysis  (2002),  and  other  financial/economics  texts. 
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Once  volatility  and  NPV  calculations  are  obtained,  the  Crystal  Reports® 
Real  Options  software  can  be  utilized  to  calculate  the  option  value.  At  this  point,  an 
assessment  may  be  made  as  to  whether  a  strategy  that  includes  the  purchase  of  an  option 
(e.g.  pilot  test  or  partial  roll  out)  is  more  valuable.  This  step  in  ROM  also  provides 
decision  makers  with  important  insights  such  as: 

(1)  Value  of  perfect  information.  This  provides  a  dollar  amount 
for  how  much  we  should  we  be  willing  to  spend  on  pilot  tests  or  advanced 
functionality  before  embarking  on  a  complete  rollout. 

(2)  Optimal  time  to  expand.  This  estimates  when  expansion  will 
make  economic  sense. 

(3)  Breakeven  cost  of  waiting.  Based  on  the  cost  of  waiting  this 
illustrates  how  long  we  should  be  willing  to  wait  before  executing  the 
strategy  or  exercising  the  option  (Mun  2003). 
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Figure  19  is  an  example  of  the  output  obtained  that  can  be  used  to  value 
the  different  strategies.  This  additional  information  provided  by  the  proposed  ROM- 
ITPM  methodology  gives  decision-makers  the  tools  to  make  better  decisions  while 
minimizing  financial  risk  in  situations  where  considerable  uncertainty  exists.  Combining 
the  structure  of  strategic  trees  with  the  analytic  discipline  of  Black-Scholes  and  lattices 
provides  the  decision-maker  with  a  powerful  tool  for  assessing  investments  that  contain 
considerable  risk  and  uncertainty. 
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Figure  19.  Output  from  Crystal  Reports®  Real  Options  Software. 


c.  Acting  on  the  Option 


Acting  on  or  exercising  the  option  is  the  final  step  in  this  three- step 
process.  As  discussed  previously  an  option  gives  its  owner  the  right  to  take  an  action  in 
the  future  without  obligating  the  owner  to  exercise  that  option  if  conditions  are 


45 


unfavorable.  It  stands  to  reason  that  in  ROM,  the  option  is  only  exercised  when  the  value 
derived  by  exercising  the  option  is  deemed  sufficient  to  warrant  exercising  the  option. 
Therefore,  exercising  the  real  option  consists  of  the  decision  to  pursue  a  project  by 
signing  a  contract  or  purchase  agreement.  The  project  phases  identified  in  step  one  of 
this  three- step  process  allow  managers  to  view  each  stage  as  the  purchase  of  an  option  to 
pursue  the  next  stage  of  a  project.  This  important  aspect  of  this  process  gives  the 
organization  an  opportunity  to  learn  more  about  the  risks  involved  in  a  project  before 
moving  ahead  into  a  progressively  larger  (more  expensive)  stage.  By  using  ROM  in 
ITPM  the  organization  can  make  better  investment  decisions  and  utilize  the  flexibility  of 
options  to  avoid  missing  important  opportunities. 

This  study  offers  a  structured  approach  for  determining  when  the  ROM- 
ITPM  methodology  should  be  used.  The  logical  diagram  provided  in  Figure  12b  is 
designed  to  aid  managers  in  deciding  when  to  employ  the  ROM-ITPM  methodology. 
Figure  20  illustrates  the  proposed  ROM-ITPM  process  advocated  in  this  study.  This 
ROM-ITPM  process  begins  in  the  ITPM  select,  manage,  and  evaluate  cycle.  Managers 
can  then  use  the  portfolio  map  to  evaluate  proposed  projects  for  viability  and  fit.  This 
stage  involves  a  review  of  the  project’s  business  case  including  discounted  cash  flow 
analysis.  The  initial  option  framing  step  takes  place  when  a  strategic  tree  is  developed  to 
identify  possible  strategies  for  executing  the  project  incorporating  options  (pilot  tests, 
advanced  procurements  of  features/capabilities  etc.).  Once  potential  strategies  are 
identified  the  analyzing  step  begins  as  options  are  analyzed  using  Crystal  Reports®  Real 
Options  software  to  simulate  discounted  cash  flows  and  calculate  option  values.  In  the 
final  step,  managers  are  able  to  act  on  the  option  by  utilizing  the  outputs  obtained  from 
the  ROM-ITPM  methodology  to  compare  competing  projects,  optimize  a  portfolio  of 
investments,  or  make  new  (or  expansion)  investment  decisions.  This  proposed  ROM- 
ITPM  methodology  will  be  tested  in  Chapter  IV  using  the  NAVSUP  AIT  project  as  an 
example. 


46 


Viability 


Business  Case 
Assessment 


high 


Portfolio  Map 


low 


F^assigia 

OUbcxioe 

Invest 

Kill 

Revamp 

Fit 


i - i  Most  immediate  and  relevant  opportunities 


Strategic  Tr 


Exercise  Option 
(Expand,  Exit,  Wait 
etc..,) 


Initial 

Investment 
w/  option 

Abandon/Divest 


Option 

Analysis 


Forecasting  & 
Prob.  Analysis 


Forecast:  CDCF  Year  5 
Frequency  Chart  43  Outliers 


Do  nothing 


-374,762.94  -123,792.34  127,178.26  378,148.85  629,119.45 

Certainty  is  52.38%  from  -Infinity  to  122,212.25  Dollars 


Step  2  K 
Analyz^ 


Step  3k 


Figure  20.  ROM-ITPM  Methodology. 
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IV.  MANAGING  INVESTMENT  RISKS  WITH  THE  ROM-ITPM 

FRAMEWORK 


A.  AUTOMATIC  IDENTIFICATION  TECHNOLOGY  (AIT)  AND  SERIAL 

NUMBER  TRACKING 

The  Department  of  Defense  Automatic  Identification  Technology  Office 
(DODAIT)  has  defined  Automatic  Identification  Technology  (AIT)  as  “the  basic  building 
block  in  the  Defense  Department's  efforts  to  provide  timely  asset  visibility  in  the  logistics 
pipeline,  whether  in-process,  in- storage,  or  in- transit”  (DOD  2003).  There  are  many 
forms  of  AIT  media  including  barcodes,  radio  frequency  ID,  satellite  tracking  systems, 
smart  cards/CAC,  optical  memory  cards,  and  contact  memory  buttons.  Each  of  the  DOD 
services  have  begun  developing  programs  to  facilitate  the  use  of  AIT  to  enhance  asset 
visibility  and  support  the  needs  of  our  agile  military  forces  by  enabling  data  collection, 
tracking,  documenting  and  controlling  our  agile  military  forces  and  its  material. 

NAVSUP  is  currently  leading  the  Department  of  the  Navy  (DON)  AIT  through  its 
Serial  Number  Tracking  (SNT)  project.  The  SNT  project  was  initiated  in  November 
1998  in  response  to  the  Aviation  Supply- Maintenance  Readiness  (AMSR)  review,  which 
determined  that  a  serial  number  tracking  system  was  required  to  assist  in  determining 
what  factors  were  causing  increasing  costs  and  decreasing  reliability  of  aviation  depot 
level  repairables  (NAVSUP  2003a).  SNT  is  defined  in  the  NAVSUP  SNT  Concept  of 
Operations  as  “closed- loop  cradle -to- grave  tracking  of  maintenance  critical  serialized 
parts,  providing  asset  and  material  status,  and  enabled  by  Automatic  Identification 
Technology”  (NAVSUP  2000).  Once  implemented,  SNT  will  consist  of  a  web-based 
Serial  Number  Tracking  system  that  serves  as  a  data  warehouse  for  all  material  being 
tracked.  This  web-based  system  will  provide  near  real-time  information  to  customers 
relying  on  timely,  accurate  data.  The  second  piece  of  the  SNT  program  includes  the  use 
of  an  automated  method  of  marking  and  identifying  equipment  to  eliminate  the  need  for 
manual  entry  of  data.  The  goals  of  this  program  include:  (1)  Reduction  in  total  inventory 
ownership  costs,  (2)  Reduction  in  secondary  inventory  level  and  (3)  Enhancement  of 
customer  (war  fighter)  satisfaction  (NAVSUP  2000). 
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The  primary  media  envisioned  for  use  in  SNT  are  two-dimensional  (2-D) 
barcodes  and  contact  memory  buttons.  Two-dimensional  barcodes  are  the  most  advanced 
barcode  technology  that  allows  for  storage  of  over  7000  numeric  or  over  4200 
alphanumeric  characters  (NAVSUP  2000).  This  data  storage  method  provides  the  wide 
range  of  data  needed  by  military  users,  military  and  civilian  repair  personnel  and 
suppliers.  The  barcode  technology  will  dramatically  reduce  the  need  for  re-entry  of  data 
and  reduce  the  errors  created  by  multiple  data  entry. 

Contact  memory  buttons  (CMBs)  are  also  an  integral  part  of  NAVSUP’ s 
proposed  solution.  A  CMB  is  a  small  (size  of  a  coin)  data- storage  device  that  can  be 
attached  to  material  to  electronically  store  data  for  accurate  material  identification.  These 
devices  cost  between  $7-$13  and  can  store  2KB- SMB  of  data  depending  on  the  type  of 
CMB.  This  technology  provides  another  viable  method  of  eliminating  errors  created  by 
manual  data  entry. 

B.  EVALUATING  SNT  WITH  TRADITIONAL  DISCOUNTED  CASH 
FLOWS 

Traditional  discounted  cash  flow  methods  provide  a  simple  mechanism  for 
determining  the  desirability  of  a  project.  This  analysis  is  performed  by  identifying  the 
relevant  cash  flows  for  a  given  project  over  a  specified  time  period.  These  cash  flows  are 
then  discounted  based  on  the  market  risk- adjusted  discount  rate  known  as  the  weighted 
average  cost  of  capital  (WACC).  Discounting  these  cash  flows  results  in  the  present 
value  of  future  cash  flows  (or  savings)  relevant  to  the  project.  The  net  present  value 
(NPV)  is  then  derived  by  computing  the  sum  of  cash  flows  minus  the  initial  outlays  for 
the  project.  When  projects  consist  only  of  a  stream  of  costs,  the  project  with  the  lowest 
NPV  is  more  attractive.  If  the  project  cash  flows  are  revenues  or  cost  savings,  the  project 
proposal  with  the  highest  NPV  is  more  attractive.  Simply  stated,  NPV  is  utilized  to 
assess  the  economic  merit  of  projects  as  well  as  a  tool  to  compare  competing  alternatives. 

The  SNT  project  has  been  presented  as  an  investment  that  will  generate  cost 
savings.  Therefore,  a  higher  NPV  is  desirable  when  evaluating  this  project.  Fitting  Out 
&  Supply  Support  Assistance  Center  (FOSSAC)  and  SABRE  CORPORATION  provided 
the  initial  business  case  for  this  project.  The  current  SNT  project  managers  have 

subsequently  refined  this  business  case  analysis.  Figure  21  is  a  summary  of  the  analysis 
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performed  for  the  SNT  project  (FOSSAC  1999).  Assuming  a  $3.3M  initial  investment 
(combined  ‘99/’00),  a  standard  10%  discount  rate,  and  five  years  of  uneven  cash  flows, 
the  NPV  of  the  cash  flows  for  this  project  is  $116,416,842.  Based  on  this  analysis,  this 
project  is  an  easy  choice.  However,  as  we  shall  see,  this  analysis  does  not  capture  many 
other  elements  that  affect  other  investment  decisions  during  the  life  cycle  management  of 
this  project. 
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Figure  21.  SNT/AIT  Return  on  Investment  Analysis. 


This  analysis  provides  a  snapshot  of  the  potential  benefits  of  the  SNT  project 

based  on  the  circumstances  presented.  However,  relying  solely  on  this  traditional 

analysis  fails  to  account  for  the  uncertainty  of  future  events  and  the  flexibility  that 

managers  have  in  how  and  when  to  execute  this  decision  to  invest.  What  happens  when 

initial  cash  flow  assumptions  are  not  realized  over  time?  What  happens  if  the  technology 

or  procedural  requirements  prove  to  be  too  cumbersome  and  never  become  widely 

accepted  and  used?  What  happens  if  technological  changes  result  in  a  better  technique  to 
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accomplish  the  objective?  These  questions  underscore  the  fundamental  problem  of 
relying  solely  on  traditional  methods  such  as  DCF  analysis  to  evaluate  projects.  The 
uncertainty  inherent  in  many  technology-based  capital  investment  decisions  is  not 
accounted  for  in  DCF  analysis.  ROM  provides  a  mechanism  to  supplement  traditional 
DCF  methodology  to  gain  further  insights  into  potential  investments. 

C.  USING  ROM  TO  EVALUATE  THE  SNT  PROJECT 

Chapter  III  provided  a  brief  outline  of  the  ROM-ITPM  methodology  that  is 
advocated  by  this  study.  At  this  point  in  the  discussion  it  is  important  to  point  out  once 
more  that  the  ROM-ITPM  methodology  is  not  intended  to  replace  the  traditional  methods 
of  evaluating  projects.  Instead,  this  methodology  is  advocated  as  a  useful  supplement  to 
the  tools  already  in  use.  As  discussed  earlier,  ROM  provides  managers  with  an 
alternative  view  of  project  value  that  takes  into  account  management’s  ability  to  alter 
decisions.  The  ROM-ITPM  methodology  advocated  by  this  study  uses  a  three  step 
process  that  provides  the  rigor  of  traditional  DCF  methods  along  with  simulation  and  risk 
analysis  tools  available  in  the  Crystal  Reports®  software.  This  software  has  been  selected 
because  it  is  a  widely  used  risk  analysis  tool  that  has  been  catered  specifically  to  real 
options  applications.  The  remainder  of  this  chapter  is  devoted  to  the  application  of  the 
ROM-ITPM  methodology  in  evaluating  the  NAVSUP  SNT  project  to  discern  ROM- 
ITPM’ s  usefulness  as  a  tool  for  selecting  and  evaluating  projects.  The  discussion  will 
follow  the  same  three- step  pattern  presented  in  Chapter  III:  framing  the  option,  analyzing 
the  option  and  acting  on  the  option. 

1.  Framing  the  Option 

The  first  step  in  the  ROM-ITPM  framework  is  to  frame  the  option.  Framing  the 
option  involves  determining  whether  options  exist  and  whether  there  is  uncertainty.  The 
SNT  project  has  been  designed  in  response  to  the  Aviation  Maintenance- Supply 
Readiness  (AMSR)  Review,  which  provided  goals  to  lower  maintenance  and  supply  costs 
while  increasing  fleet  readiness  (NAVSUP  2000).  Although  SNT  is  built  upon  the 
objective  of  lower  maintenance  and  supply  costs  and  increased  fleet  readiness,  multiple 
options  exist  for  how  SNT  might  reach  this  objective.  In  other  words,  there  is  no 
mandate  that  dictates  one  path  to  achieving  the  stated  objective.  Another  important  factor 
is  that  SNT  is  a  technology-based  solution  to  the  problem  that  is  subject  to  risks  and 
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uncertainty  inherent  in  all  IT  projects:  acceptance  of  the  technology,  superceding 
technology,  and  compatibility  with  existing  architectures.  The  presence  of  these 
uncertainties  and  the  availability  of  alternatives  make  SNT  an  appropriate  candidate  for 
demonstrating  the  ROM-ITPM  approach. 

Framing  the  options  associated  with  the  SNT  project  requires  management 
judgment  in  defining  the  applications  of  SNT.  These  potential  applications  are  then 
presented  as  a  set  of  options  within  the  boundaries  of  the  SNT  project.  Keep  in  mind  that 
if  we  were  discussing  choosing  among  competing  projects  each  project  would  be  viewed 
as  a  separate  option  to  a:hieve  a  given  objective.  Figure  22  is  a  strategic  tree  that 
displays  different  strategies  available  to  execute  the  SNT  project. 


Do  nothing 

Figure  22.  Serial  Number  Tracking  Strategic  Tree. 


This  strategic  tree  lays  out  three  initial  strategic  alternatives:  (1)  make  no 
investment  in  SNT  (Do  nothing),  (2)  embark  on  the  aviation  portion  of  the  Serial  Number 
Tracking  initiative  as  a  one-time  investment,  or  (3)  embark  on  the  aviation  SNT  initiative 
using  a  phased  approach  with  an  option  to  expand  into  maritime  repairable  management. 
Analyzing  options  one  and  two  are  fairly  straightforward.  Strategy  one  is  a  choice  to 
continue  to  do  nothing  and  allow  costs  associated  with  the  loss  of  repairables  and 
researching  lost  repairables  to  chip  away  at  dwindling  financial  resources.  Strategy  two 
can  be  accomplished  using  traditional  discounted  cash  flow  methods  similar  to  the 
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method  described  above.  This  approach  is  a  feast  or  famine  approach  that  entails 
committing  to  the  total  investment  and  running  the  risk  of  having  the  project  Ml. 

Strategy  three  incorporates  the  flexibility  to  expand  into  maritime  repairable 
management  and  the  option  to  abandon  the  initiative  based  on  better  information  over 
time.  Strategy  three  incorporates  the  disciplined  approach  advocated  by  this  study  and 
demonstrates  the  additional  insights  available  using  ROM-ITPM  methodology.  Although 
the  current  focus  of  the  SNT  initiative  is  on  aviation  repairable  management,  for  the 
purposes  of  illustration  we  shall  introduce  the  option  of  expansion  into  Navy  maritime 
(non- aviation)  repairable  management.  The  cost  and  savings  figures  used  for  this 
expansion  initiative  are  rough  estimates  provided  by  SNT  project  managers  and  are  for 
illustrative  purposes  only.  These  figures  do  not  reflect  the  type  of  rigorous  analysis  that 
would  be  required  for  a  detailed  business  case  analysis.  However,  these  estimates  are 
suitable  for  the  purposes  of  illustrating  the  type  of  additional  information  that  can  be 
obtained  through  the  ROM-ITPM  approach. 

2.  Analyzing  the  Option 

Utilizing  the  tools  of  ROM,  strategic  alternative  three  will  be  analyzed  using  the 
Expand/ Abandon  Option  Model.  4  This  model  is  one  of  many  option  models  available  for 
solving  Real  Options  problems  in  the  Crystal  Ball®  Real  Options  Software.  We  begin 
our  analysis  by  identifying  the  five  common  inputs  to  the  Black- Scholes  formula:  (1) 
value  of  the  underlying  asset  -  V,  (2)  exercise  price- X,  (3)  time  to  expiration- T,  (4)  risk¬ 
free  rate-  r,  and  (5)  volatility-  a .  Although  the  financial  data  used  in  this  example  is 
based  on  available  business  case  information  for  SNT,  assumptions  have  been  made 
regarding  the  exercise  price/expansion  cost  (X=$80M),  time  to  expiration  of  the  option 
(T=3  years),  and  risk-free  rate  (r  =  5%).  We  know  from  the  business  case  analysis  done 
on  this  project  that  the  NPV  for  the  initial  project  is  $116,416,842  and  a  corresponding 
present  value  (PV)  of  $182,975,000.  This  PV  is  the  value  of  the  underlying  asset  (V)  and 
is  calculated  by  adding  back  the  cost  of  the  initial  project  investment  to  the  NPV 
(116,416,842  -I-  66,560,000).  Based  on  the  cash  flow  assumptions  used  to  calculate  the 

4  The  Expand/Abandon  Option  Model  is  one  of  several  different  categories  of  options  models 
available  in  Crystal  Ball®  Real  Options  Software.  This  study  does  not  seek  to  address  all  of  the  different 
types  of  Real  Options  models.  More  information  regarding  this  and  other  specific  Real  Options  models  can 
be  found  in  Dr.  Johnathan  Mun’s  Rea/  Options  Analysis  (2002),  and  other  financial/economics  texts. 
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PV,  volatility  is  computed  using  the  logarithmic  present  value  approach  discussed  in 
Chapter  III.  Figure  23  illustrates  the  solution  obtained  using  our  selected  software.  The 
resulting  volatility  estimate  (o)  for  the  SNT  project  is  46.29%  indicating  that 
considerable  uncertainty  in  projected  cash  flows  exists.  The  Expand/Abandon  Option 
Model  also  incorporates  two  additional  pieces  of  data:  the  expansion  factor  (1.42)  and 
the  salvage  value  ($60M).  The  expansion  factor  is  obtained  by  dividing  the  PV  of  the 
project  including  projected  cash  flows  from  expansion  by  the  PV  of  the  original  project 
($259M/$182M).  The  salvage  value  is  included  to  illustrate  the  additional  information 
that  can  be  derived  in  project/asset  investments  with  a  salvage  value. 
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Figure  23.  Calculated  Volatility. 

Once  these  initial  PV  and  volatility  calculations  have  been  completed,  we  now 
have  the  required  information  to  complete  the  Black- Scholes  and  binomial  lattice 
computations  displayed  in  Figure  24. 


55 


Input  Paranri6t6rs 

Expiration  in  Years 

3.00 

Volatility 

46.29% 

PV  Asset  Value 

$162.98 

Risk-Free  Rate 

5.00% 

Dividend  Rate 

0.00% 

Expansion  Factor 

1.42 

Expansion  Cost 

$80.00 

Salvage  Value 

$60.00 

ti*"  Bw'  Ln«t+  Fst^*  rwir  wriSr/j  £el  njji  y*  i^crotj^i: 


Vo  jiJ 


ArtKtfictn  i?p0on  t&  Ext>iri4  tnci.At>an4o^ 

nraiMH 


r  Inlfi  riKktf  t  Cdkiiaivu  ~ 


-  Irput 

EKprGlicn  r  V'E-sn 

VnMWy 

*182.98 

Ridt-Frec  RhIe 

£(JQK 

□rvid^nd 

EkpanEon  Faclnr 

1  Al 

EupFidEHn  Coet 

530  CO 

Ealutaigd  VsJud 

I9Q0Q 

Man  I  h4alp  | 


rjLTrtbw-ofTnrtt  Eigps 

Tinn  Step  SiEe  |dl) 
l^dump  Sz4 1}4 

Donn  Jump  SiiE 

Pi^MdGyfriii  Fmb^blhii  i^' 

a.GDDG 

1.4313 

a.Egs7 

-  Paajh 

ertomidl.AppiQgch  ENPV 

At^tnc-an  Ctoddd  Furm  EMPV 

il«ul2 

e^rh-SchalPs  Hndpl  ENP^-- 

5193  jR 

a^pcfLaflitd  3 

1212.11 

Step  D  SlEp  1 

SlEp2 

StEp  3 

SlEp  4 

SlEp  5 

1BQ?e  35109  374.03 

U?.iA  192.99 

ES.32 

636.de 

2gi.Be 

127.E4 

B3.41 

707.60 

374.GQ 

101^ 

Be.3£ 

43.  CO 

1DE8DD 
929  49 
261 JW 
127  34 
62.41 

30  46 

-  OpJtwn  - 

21211  312.12 

4Ei3Dg 

£&.4£. 

1D1271 

149099 

141.i: 

304.54 

3CaS6 

454.E 

631.30 

•130.E3 

I0B.IG 

®189 

71.11 

68.32 

12734 

60  DO 

6£4l 

60  DO 

|-  C^imLdbtB* 


cdntinun  [u^trui  CHlriLU  c^nhnun  cn^trua  EKpaatl 

rcrthLH  [crinLK  conlinuE  [cntnue  EK^aatl 

tcrtKis  cflifilihua  CFrtriue 

cnnlinuc  ccrtrue  End 

Ali«4i4cirii  End 


AbnftriMi 


:iptafl*r|  :#  1^  j=|Rhil5^M...J  fjDawrte...|  ^ftQ_Hrid...|  \  g|ae«J  |[^rfiiwi-  K 103] ph 


Figure  24.  Crystal  Ball®  Real  Options  Output. 

The  software  generates  three  binomial  lattices.  The  first  lattice  is  the  underlying 
pricing  lattice  that  provides  the  manager  with  a  range  of  values  indicating  the  relative 
value  of  the  underlying  asset  dependent  on  best/worse  case  scenarios.  This  information 
allows  the  manager  to  quantify  the  cost  of  waiting  and  identify  the  optimal  time  to 

expand  given  a  set  of  possible  outcomes.  For  our  SNT  example,  this  information  is 
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useful  in  deciding  when  and  if  expansion  into  the  maritime  initiative  is  prudent.  The 
large  positive  value  obtained  makes  a  strong  case  for  expansion  into  the  maritime 
initiative.  This  lattice  identifies  that  the  manager  should  be  willing  to  pay  up  to 
$182,975,000  for  the  initial  aviation-focused  SNT  project.  Once  again,  because  this 
project  has  an  extremely  high  payoff,  the  decision  to  expand  is  easy.  However,  it  is  easy 
to  see  how  this  type  of  information  could  be  extremely  valuable  for  projects  without  such 
dramatic  payoffs. 

The  second  lattice  generated  is  the  option  valuation  lattice.  The  valuation  lattice 
illustrates  the  increase  in  the  project  value  due  to  the  value  created  by  the  option.  The 
actual  value  of  the  option  is  computed  by  taking  the  difference  between  the  step  zero  (0) 
values  of  the  two  lattices  (underlying  asset  lattice  and  option  pricing  lattice).  This  allows 
the  manager  to  see  the  value  of  the  option  under  a  range  of  possible  outcomes.  It 
provides  a  best/worst  case  scenario  that  allows  the  manager  to  determine  how  much  (s)he 
should  be  willing  to  pay  for  an  option.  In  the  case  of  SNT,  this  information  will  provide 
an  estimate  of  how  much  should  be  spent  on  pilot  projects  to  test  the  technology  before 
expanding.  The  results  of  this  analysis  demonstrate  that  no  more  than  $29,130,000 
($212M-182.98M)  should  be  spent  on  an  option  (pilot  test,  advance  purchase  of 
functionality  to  be  used  in  the  future  etc.)  before  choosing  to  exercise  the  option  to 
embark  on  the  maritime  phase.  Here  we  notice  that  the  $212  million  dollar  value  of  the 
project  that  includes  the  option  is  substantially  different  from  the  $182  million  dollar  PV 
originally  computed  for  the  SNT  aviation  initiative.  Quantifying  the  value  of 
management’s  flexibility  using  options  creates  the  increase.  The  third  lattice  is  the 
decision  lattice  that  interprets  the  output  and  informs  managers  of  when  it  will  be  prudent 
to  expand  or  abandon  a  project  or  strategic  investment.  The  use  of  software  tools 
simplifies  the  rigorous  analysis  to  provide  useful  information  for  better  investment 
decisions. 

3.  Acting  on  the  Option 

The  crucial  final  step  in  the  ROM-ITPM  methodology  is  to  apply  the  insights 
gained  through  framing  and  analyzing  the  options  to  making  investment  decisions.  These 
decisions  include  whether  to  make  an  initial  investment,  expand  an  existing  project  based 
on  the  results  of  the  existing  project  (expansion  option),  whether  to  wait  for  more 
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information  (wait/timing  option)  or  whether  to  divest/terminate  a  project  (abandon 
option).  Each  of  these  alternatives  is  reflective  of  the  dynamic  nature  of  the  decisions 
that  face  leaders  every  day.  Our  SNT  example  illustrates  how  ROM-ITPM  methodology 
can  help  managers  identify  different  strategic  decision  pathways,  prioritize  these 
pathways/projects,  and  place  a  value  on  them. 

The  information  obtained  from  this  analysis  goes  beyond  the  static  discounted 
cash  flow  analysis.  In  our  example  the  SNT  maritime  focus  was  not  only  identified  as  an 
option  but  a  value  could  be  placed  on  that  option.  Best  and  worst  case  scenarios  were 
identified  to  help  managers  determine  their  degree  of  exposure  to  financial  risk. 
However,  it  is  important  to  note  that  the  proposed  ROM-ITPM  methodology  and  the 
neatly  packaged  solution  obtained  through  software  should  not  be  viewed  as  the  silver 
bullet  that  provides  the  definitive  solution.  Instead,  the  value  of  the  ROM-ITPM  process 
lies  in  the  disciplined  approach  that  causes  managers  to  view  investments  as  options 
which  reflects  the  true  nature  of  most  investment  decisions.  The  added  benefit  is  a 
solution  that  provides  best/worst  case  scenarios  for  the  SNT  initiative  that  allows  the 
manager  to  estimate  how  much  they  should  be  willing  to  spend  on  pilot  tests,  know  when 
it  makes  economic  sense  to  expand  a  project  and  know  the  cost  of  waiting. 

The  SNT  project  is  a  relatively  easy  decision  based  on  the  business  case 

presented.  However,  we  can  see  from  this  example  that  using  the  ROM-ITPM 

framework  can  still  provide  valuable  information.  Different  strategic  investment  decision 

pathways  were  identified  (i.e.  maritime  initiative  option).  This  process  allowed  the 

strategic  pathways  to  be  evaluated  for  viability  and  fit  using  the  portfolio  map.  The 

Black- Scholes  and  binomial  lattice  solutions  provided  information  useful  in  evaluating 

competing  options  and  prioritizing  SNT  options.  Setting  up  the  SNT  project  as  a  series 

of  options  has  laid  the  foundation  for  developing  new  strategic  pathways  that  may 

include  outsourcing  the  project,  developing  greater  functionality  for  tracking  maintenance 

actions,  and  incorporating  newer  technology  that  may  be  developed  in  the  future.  The 

NAVSUP  organization  can  even  build  upon  this  analysis  to  evaluate  the  opportunity  to 

expand  the  technology  employed  by  the  SNT  project  to  track  test  equipment,  PDAs, 

laptops  and  other  pilferable  equipment.  The  information  provided  by  the  ROM-ITPM 

methodology  reveals  important  opportunities  managers  of  the  SNT  project  can  exploit  to 
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meet  the  objective  of  reducing  the  cost  of  inventory  management  and  improving  the 
visibility  of  high-cost  parts.  Based  on  the  analysis  performed,  the  SNT  project  is  a 
winner  and  expansion  into  a  maritime  initiative  should  be  pursued  immediately. 
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V.  SUMMARY 


A.  RESULTS  OF  THE  STUDY. .  .A  MODEL  FOR  ADDRESSING  RISK 

The  passage  of  legislation  such  as  the  Clinger- Cohen  Act,  Paperwork  Reduction 
Act  of  1995,  and  the  Government  Performance  and  Results  Act  of  1993  have  emphasized 
the  importance  of  a  disciplined  approach  to  technology  investments.  ITPM  has  been 
identified  as  the  mechanism  by  which  IT  investments  will  be  selected,  evaluated  and 
managed.  This  study  has  explored  the  limitations  of  current  investment  analysis  tools 
being  used  to  select  and  evaluate  IT  investments.  Tools  such  as  the  DCF  methods 
commonly  used  to  evaluate  investments  are  extremely  useful  in  analyzing  investments 
provided  the  assumptions  regarding  cash  flows  (or  cost  savings)  hold  true.  Such  tools 
provide  important  information  but  they  fail  to  account  for  the  iterative  nature  of  real 
world  decisions.  These  methods  treat  investment  decisions  as  a  static  process  and  do  not 
reflect  management’s  ability  to  alter  decisions  as  conditions  change. 

The  ROM- ITPM  methodology  has  been  introduced  as  an  additional  tool  for 
evaluating  IT  investments.  This  methodology  is  intended  for  use  in  circumstances  when 
the  decision-maker  has  flexibility  regarding  what,  when,  and  how  an  investment  is  made. 
The  logical  diagram  provided  in  Chapter  III,  Figure  12(b)  has  been  presented  as  a  tool  for 
determining  when  the  ROM-ITPM  methodology  should  be  used.  Again,  the  ROM-ITPM 
methodology  is  presented  as  a  supplement  to  existing  tools  for  evaluating  investments— 
not  a  replacement.  It  is  one  more  tool  for  managers  to  use  when  evaluating  investment 
opportunities.  This  methodology  uses  rigorous  analytical  tools  to  derive  the  value  of 
investment  alternatives  based  on  determining  the  level  of  uncertainty  associated  with 
predicted  cash  flows.  The  ROM-ITPM  process  begins  in  the  ITPM  select,  manage,  and 
evaluate  cycle.  Managers  use  the  portfolio  map  to  evaluate  proposed  projects  for 
viability  and  fit,  which  includes  a  review  of  the  project’s  business  case  including 
discounted  cash  flow  analysis.  The  framing  step  begins  when  a  strategic  tree  is 
developed  to  identify  possible  strategies  for  executing  the  project  incorporating  options 
(pilot  tests,  advanced  procurements  of  features/capabilities  etc.).  Once  potential 
strategies  are  identified  the  analyzing  step  begins  as  options  are  analyzed  using  Crystal 
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Reports®  Real  Options  software  to  simulate  discounted  cash  flows  and  calculate  option 
values.  In  the  final  step,  managers  are  able  to  act  on  the  option  by  utilizing  the  outputs 
obtained  from  the  ROM-ITPM  methodology  to  compare  competing  projects,  optimize  a 
portfolio  of  investments,  or  make  new  (or  expansion)  investment  decisions.  These  steps 
are  illustrated  in  Figure  20.  The  mathematical  discipline  of  this  approach  helps  to  place  a 
value  on  the  uncertainty  commonly  associated  with  strategic  investments.  However,  the 
real  benefit  of  this  approach  is  that  it  allows  decision-makers  to  identify  investments  as 
options,  which  reflects  the  true  nature  of  most  investment  decisions  and  what  most 
managers  do  intuitively,  but  here  with  rigor  and  precision.  The  solutions  obtained 
provide  best/worst  case  scenarios  and  allows  the  manager  to  estimate  the  maximum  that 
should  be  spent  on  pilot  tests,  know  when  it  makes  economic  sense  to  contract,  expand, 
abandon,  change,  and  wait  given  the  circumstances  surrounding  a  project. 

B.  BROADER  IMPLICATIONS  OF  THIS  STUDY 

This  study  has  identified  how  the  Real  Options  Method  can  be  utilized  as  a  tool  to 
manage  the  risks  associated  with  investments  in  the  rapidly  changing  world  of 
technology.  As  we  have  discussed,  this  method  is  already  being  widely  used  by 
managers  of  pharmaceutical  R&D,  petroleum  exploration,  and  energy  trading  companies 
to  manage  the  financial  risk  and  uncertainty  of  capital  investment  decisions.  The 
disciplined  approach  to  evaluating  investments  offered  by  ROM  is  not  only  useful  for  IT 
investments  but  also  for  other  investments  that  involve  committing  resources  when  there 
is  considerable  uncertainty  regarding  outcomes  (returns  on  investment).  This  is  an  apt 
description  of  most  of  the  investments  that  are  made  within  the  Department  of  Defense 
(DOD).  As  discussed  in  Chapter  I,  the  Office  of  Force  Transformation  has  already 
offered  the  Real  Options  Method  as  a  possible  mechanism  for  evaluating  new  DOD 
programs.  A  recent  Office  of  Force  Transformation  article  asserts  that  “leaders  of  the 
military  services  now  confront  the  dilemma  of  whether  or  not  to  invest  in  a  particular 
stage  of  a  new  program,  or  given  market  and  technology  uncertainties  surrounding  the 
perceived  need,  delay  the  decisions”  (Glaros  2003). 

The  Planning,  Programming,  and  Budgeting  System  introduced  by  then  Secretary 
of  Defense  Robert  McNamara  in  the  1960’s  often  takes  as  long  as  eight  years  to  field  new 
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programs  (Glares  2003).  The  recently  revised  PPBS  known  as  the  Planning 
Programming  Budgeting  and  Execution  System  (PPBES)  discussed  in  Chapter  II  of  this 
study  has  attempted  to  improve  the  process  but  may  still  lack  the  ability  to  capture  the 
economic  value  of  capital  investments  in  an  environment  fraught  with  uncertainty  and 
change.  The  disciplined  ROM-based  approach  offered  in  this  study  has  potential  to  help 
resolve  these  shortcomings. 

In  spite  of  the  PTA  restrictions  discussed  in  Chapter  I,  the  ROM-ITPM 
methodology  can  still  provide  important  information  for  deciding  which  programs  should 
be  funded  based  on  fit  and  how  the  program  should  be  pursued  (in-house  vs. 
outsourcing).  The  flexibility  required  to  deal  with  a  rapidly  changing  global  landscape 
will  require  efforts  to  increase  the  flexibility  of  the  existing  PPBES  process  to  give 
managers  of  major  programs  greater  flexibility  to  take  advantage  of  investment 
opportunities  by  shifting  resources.  Today,  this  flexibility  is  being  incorporated  into  our 
acquisitions  process  through  spiral  acquisition  and  project  development  techniques.  The 
ROM-ITPM  is  a  good  fit  to  facilitate  these  techniques  by  providing  a  financial  tool  that 
can  evaluate  multiple  strategic  pathways.  As  economic  resources  become  more  and  more 
constrained  it  will  be  important  to  explore  new  methodologies  like  ROM  to  sustain 
competitive  advantage  in  a  rapidly  changing  world. 

C  AREAS  FOR  FUTURE  STUDY 

In  the  course  of  researching  this  topic  three  areas  for  future  study  have  been 
identified.  First,  the  application  of  the  Real  Options  Method  in  the  DON  provides 
significant  opportunities  in  identifying  the  appropriate  funding  levels  for  pilot  projects. 
In  recent  years  we  have  seen  the  DON  embark  upon  four  separate  Enterprise  Resource 
Planning  (ERP)  pilots.  At  the  same  time  the  DON  has  also  begun  the  ambitious  Navy 
Marine  Corps  Intranet  (NMCI)  initiative,  the  largest  seat  (desktop)  management  contract 
ever.  Future  research  can  be  conducted  to  explore  what  b  the  maximum  amount  DON 
should  be  willing  to  pay  for  pilot  projects  such  as  ERP.  This  research  could  also  assess 
what  would  be  the  value  of  a  phased  approach  (considering  expansion,  exit  and  wait 
options)  to  the  NMCI  project. 
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A  second  research  opportunity  would  be  to  establish  a  proposed  mechanism  to 
link  ROM  methodology  to  the  DON  E-Business  Office,  which  is  currently  responsible 
for  selecting  and  funding  pilot  projects  for  the  DON.  Identifying  opportunities  for 
increased  coordination  between  the  DON  Chief  Information  Officer  (CIO),  the  CIOs  of 
major  systems  commands,  and  the  E-Business  Office  may  result  in  a  single  IT  Portfolio 
for  the  DON  that  reflects  our  IT  needs  without  costly  duplication. 

A  third  area  for  additional  research  would  be  to  expand  upon  recent  efforts  by  the 
Office  of  Force  Transformation.  Identifying  a  framework  to  systematically  apply  ROM 
in  the  current  PPBES,  offers  hope  for  a  process  that  will  accommodate  the  uncertainty 
and  rapid  change  present  in  the  current  global  landscape.  ROM  is  not  a  panacea  that  will 
solve  all  the  problems  presented  by  investment  uncertainty  but  it  does  offer  a  regimented 
approach  to  measuring  and  leveraging  this  uncertainty. 

D.  CONCLUSION  AND  RECOMMENDATION 

This  study  has  identified  ROM  as  an  additional  tool  to  be  used  in  evaluating 
strategic  investments  that  involve  uncertainty.  The  ROM-ITPM  approach  advocated  by 
this  study  provides  a  disciplined  approach  to  evaluating  these  investments  without 
significantly  expanding  information  requirements  and  administrative  burden.  The  same 
information  currently  used  for  business  case  analyses  can  be  applied  to  the  ROM-ITPM 
framework  to  obtain  additional  insights  helpful  in  making  sound  strategic  investment 
decisions.  Therefore,  the  discipline  of  the  ROM-ITPM  approach  can  be  applied  without 
dramatic  changes  in  the  current  strategic  investment  decision-making  processes. 
Appendix  I  briefly  describes  how  interested  organizations  can  incorporate  the  ROM- 
ITPM  approach  into  their  current  processes. 

Based  on  the  results  of  this  study,  it  is  recommended  that  the  ROM-ITPM 
methodology  be  adopted  by  the  Navy  eBusiness  Operations  Office  to  support  its 
screening  process  for  Navy  pilot  projects.  This  methodology  will  assist  in  the 
determination  of  which  pilot  projects  to  fund,  and  to  what  extent  they  should  be  funded. 
It  is  also  recommended  that  the  DOD  Force  Transformation  Office  continue  its  efforts  in 
developing  mechanisms  to  apply  ROM  to  the  PPBES  in  order  to  improve  investment 
flexibility  and  reduce  financial  risks  associated  with  these  investments. 
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APPENDIX  I:  GETTING  STARTED  WITH  ROM 


Framing 

•  Initial  business  case  analyses  for  proposed  investments  are  conducted  as 
before. 

•  Utilize  the  proposed  ROM-ITPM  decision  process  (Figure  12b)  to 
identify  whether  the  ROM-ITPM  methodology  should  be  applied. 

•  A  strategic  tree  of  alternative  pathways  for  pursuing  the  investment 
should  be  developed  and  presented  as  part  of  the  initial  business  case. 

•  Focus  on  expanding  the  set  of  investment  alternatives  considered. 

•  Think  farther  into  the  future  to  identify  opportunities  for  expansion, 
waiting,  change,  and  abandonment  options,  as  more  information  is 
known. 

•  Ensure  involvement  of  a  team  (i.e.  investment  review  board)  that  consists 
of  members  with  access  to  senior  management,  and  able  to  identify  a 
broad  range  of  investment  opportunities. 

Analyzing 

•  Ensure  the  investment  review  board  contains  members  able  to  apply  the 
quantitative  tools  discussed  in  Chapter  III  available  in  the  Crystal 
Reports®  Real  Options  software. 

Acting 

•  Based  on  the  results  of  this  ROM-ITPM  methodology,  management  can 
identify  the  appropriate  strategic  pathway,  the  value  of  a  pilot,  and  how 
much  to  spend  on  a  pilot  or  advanced  capabilities. 
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